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ABSTRACT 



This third annual report on student achieveaent in 
Illinois continues th« State Board of Education practice of providing 
a synthesis of a variety of achieveaent aeasures. Test results us«d 
for this report coae froa: (1) Illinois Inventory of Educational 
Progress (HEP); (2) Scholastic Aptitude Test (SAT); (3) National 
Assessment of Educational Progress; (4) Aaerican College Test; (5) 
Decade Study Test; and (6) Second International Matheaatics Study. 
Data collected regarding student perforvance in aatheaatics showed 
that although the achieveaent of Illinois students is at the national 
average, the naiion as a whole coapares unfavorably with other 
countries. Science scores for Illinois students were at the national 
average, and the IIEP (used only in Illinois) showed iaproveaent in 
grades four, eight, and eleven. Reading achieveaent scores indicated 
that no great aoveaent took place, although fourth, eighth and 
eleventh grades shewed a slight dro^. Across all curricular areas was 
the concern that students wore not perforaing well on test items 
requiring higher order thinking skills (analysis, synthesis, 
evaluation, and problea-solving) . Student factors aost iaportant in 
explainim; perforaance levels were student expectations/standards of 
performance, number of relevant courses taken, and parental 
influences. School size was the strongest single influence aaong 
school factors and perforaance was higher in high schorls with aore 
than 215 students. The report provides support for at least four 
major reforms: (1) establishaent of learner outcomes at the state and 
local levels; (2) need for a statewide assessment process; (3) 
reorganization and/or consolidation of small high schools; and (4) 
state initiative for early childhood education to increase levels of 
achieveaent. A brief list of r::£erences and related readings is 
^^^icluded. (LMO) * 
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MEMORANDUM 



TO: State Board of Education 



FROM: 




SUBJECT: Annual Report on Student Achievement 



The attached third annual report on student achievement provides valuable 
dat 'or our continued examination of student performance trends =jnd the 
ff J which influence them. 

While the State is limited in its capacity to directly influence student 
achievement, it has the pjwer and responsibility to set conditions in place 
which encourage higher achievement. The information from this year's report 
provides additional support for at least four major refonns which are now 
under consideration by the General Assembly: 

1. There is cleai' empirical support for the establ i shrner . of learner 
outcomes at both the state and local levels. Tht report indicates 
that when students know there are high expectations and standards 
for performance, their achievement increases. 

2. The report reinforces the fact that there is a need for a rcatewide 
assessment process which allows us to measure and monitor the 
achievement of students in all Illinois schools. This process must 
do more than sample the achievement of Illinois students, as is now 
the case, or- merely test students and report their scores. The 
assessment system must hold schools accountable and provide a basis 
for program improvement in those areas in which student achievement 
(^oes not meet established standards. 
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3. The report provides strong evidence that the small enrollment size 
of many Illinois high schools Is related to lower achievement. The 
data clearly suggest that reorganization and/or consolidation of 
these small high schools may result In higher achievement. 

4, The Information reported here Indicates that achievement generally 
Is at less than desired levels. This supports the need for a state 
Initiative In early childhood education, which strong evidence 
Indicates produces Increased levels of achievement In children. 

Given these 1mportv.it implications, this report will be shared with members 
of the General Assembly and others who are currently considering major 
educational reforms. 

Throughout the year, many aspects of the dats provided in this report will 
influence the policy deliberations of the State Board of Education. 
However, H is our plan to give particular emphasis to the development of 
further action recommendations to address the concerns emanating from the 
international studies of mathematics achieveroer. To that end, we will plan 
to inake mathematics a« instructional program priority issue for action at 
the Board's work conference late this summer. 

f 

In addition, we may from time to time issue interim student achievement 
reports as a consequence of further research and analysis. The 1985 State 
Assessment has already collected extensive information on student writing 
and reading ability. The plan for the 1986 assessment in math and science 
will Include efforts to more precisely evaluate student ability to solve 
math problems that are more complex and call for higher order thinking 
skills. 
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STUDENT ACHIEVEMENT IN ILLINOIS: 1984 



EXECUTIVE SUMMARY 

INTRODUCTION 

This third annual report on student achievement In Illinois continues the 
State Board of Education practice of providing 9 synthesis of a variety of 
achievement measures. The data and Inforniatlon from these annual analyses 
of achievement become an Integral part of the data base used In policy 
deliberations by the State Board of Education and other branches of state 
government. 

Test results used for this report come from: 

the Illinois Inventory of Educational Progress (HEP), a state 
assessment used in each of the prior two reports and adnlnlstered since 
1976; 

the Scholastic Aptitude Test (SAT) which, although taken by only 15* of 
Illinois college-bound students. Is widely used by colleges and 
universities as part of entrance requirements; 

the National Assessment of Educational Progress (NAEP), a test designed 
to measure nationwide achievement; 

the American Col lege Test (ACT), the standardized test most frequently 
taken by II mois students as part of college entrance requirements; 

the Decade Stu^ Test (DST), a test administered In 1970 and 1981 to an 
identical sample of Illinois high schools; and 

the Second International Mathematics Study (SIMS), a test administered 
in twenty- two countries for purposes of comparing mathematics 
achievement. 

The subject areas reported on this year are mathematics, reading and 
science. Data collected regarding student performance In mathematics has 
made possible an In-depth analysis of the achievement of Illinois students 
In this subject area; however. In science and In reading, the data collected 
for this year's report are primarily descriptive of the trend In student 
achievement over the past several years. 

This report gives the State Board of Education and the citizens of this 
State an overview of how well Illinois students perform or have performed 
when compared to students In other parts of the nation, to the nation as a 
whole, to students of previous years, and to students of other nations. In 
addition, It puts those results Into perspective by analyzing how specific 
characteristics of students and schools relate to academic achievement. 



SUMMARY OF FINDINGS 



Across all currlcular areas Is the concern that students are not performing 
well on test Items which require higher order thinking skills: analysis, 
synthesis, evaluation and problem-solving. That Is, students do well with 
facts and one-step problems, but performance generally drops off when 
students are asked to Infer, Integrate, evaluate, condense, apply and 
synthesize Information. 



Mathematics 



Results In mathematics are a cause for deep concern. Although the 
achievement of Illinois students Is at the national average, the nation as a 
whole compares unfavorably with other countries. International comparisons 
demonstrate that Illinois students (and those of the nation) fall behind 
those of other countries early In their school experience, and the gap 
widens as they progress through school. By grade eight, students In eleven 
of nineteen other countries did better on a mathematics test than did those 
of Illinois; by grade twelve, students in ten of thirteen other countries 
did better than those of Illinois. Figure 1 shows these results. 



Figure 1 , United States' Position Relative to the Positions of Other 
Countries in the Eighth and Twelfth Grade Studies of the 
Second International Mathematics Study. 



s 

o 
u 

•> so 

s 

i 



I" 

at 4. 



UAltrd sum' Position fmnq Um 20 Couotrlo* 1" ttm 
eighth Gr«dt StuOy. 



Unittd sum' Htit on *»nf tht 1» countrm i» tht 
TwtUtn Gr«dt StM«y . 



Previous claims that the best U.S. students were equal to the best of any 
other country in mathematics are contradicted by recent evidence from 
international studies, and the best mathematics students of many nations 
clearly achieve higher than the best Illinois students. 



Illinois students are particularly weak in geometry and measurement, and 
their problem-solving skills have deteriorated significantly in the past 
twenty years. 
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Science 

Since 1980, science scores for Illinois students have been at the nat-^onal 
averaga. However, on HEP Items, which are only given In Illinois, some 
improvement has been noted in grades four, eight and eleven. Other 
questions used in the Illinois testing Indicate that out-of-school student 
activities related to science tend to diminish as students work up through 
the grades. Much less science reading, television watching of science 
programs, and self-initiated project activity takes place at eleventh grade 
than at fourth grade. 

Reading 

Illinois reading achievement continues to hover at the mid-point of the 
percentage scale. A slight drop at the fourth grade, from 56* of items 
correct in 1983 down to 5U in 1984, added to non-significant changes at the 
eighth and eleventh grade (a two-percent drop), indicate that no great 
movement took place in this area. 



ANALYSIS OF INDICATORS OF ACHIEVEMENT 

As part of an effort to determine which factors inhibit or facilitate 
student performance^ this report also includes an analysis of some specific 
indicators of achievement. 

Among the student factors studied, three are most important in explaining 
performance levels: student expectation/standards of performance, the number 
of relevant courses taken, and parental influences. When schools hold high 
expectations of their students and the students attempt to meet these 
expectations, the number of relevant courses taken appear to be enhanced and 
achievement increased. Further research is needed to clarify those 
relationships. 

Among school factors studied in an attempt to explain achievement 
differences, school size was noted as having the strongest single influence. 

Student performance on the American College Test is significantly lower 
for students from high schools enrolling fewer than 215 or more than 
1,279 students compared to the students in schools with enrollments of 
215-1 ,279. 

Across all curriculum areas of the Decade Stuc^ Tests, the highest 
achievement was in schools with more than 435 students, and the lowest 
mathematics achievement occurred in schools with less than 215 students. 

The effects of school size are also observable in results from the 
Illinois Inventory of Educational Progress. Eleventh grade students 
from high schools having 494-1279 students attained higher performances 
than students from smaller and larger schools in all areas measured by 
that test in 1984. The effects are notable when such features as school 
economic status and number of courses offered are taken into account. 
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FOREWORD 



The third annual Student Achievement report contains analyses of multiple 
indicators of student progress. This report concentrates on student 
mathematics achievement measured with Illinois, national and international 
tests. For the first time in the history of our assessment we are able to 
link multiple data sources to provide student comparisons at the state and 
national levels. In addition we describe the conditions related to student 
achievement such as school size, wealth, and course offerings. 

We hope this Information provides a framework for the improvement of student 
programs and outcome measures. For further Information about this document, 
please contact Dr. Thomas Kerins, Manager of the Program Evaluation and 
Assessment Section, of the Illinois State Board of Education. 



Ted Sanders 

State Superintendent of Education 
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CHAPTER I 
READING RESULTS 



In the last several years, the focus of reading assessments has shifted from 
testing students on Uteral reading skills to assessing what Is known as 
Inferential reading comprehension, or gaining meaning from written prose. 
The results of the recent tests continue to show a relatively low level of 
student Inferential comprehension. 

From 1976 to 1982, the Illinois reading assessment contained a number of 
Items which had been used by NAEP. Many of these questions required short 
answers and reflected the 1970s testing philosophy of the seoaratlon of 
reading skills Into such areas as "word attack, "vocabuliry/ and 
"decoding." Illinois students performed as well as their counterparts 
across the country In response to these types of questions. 

In 1982, there was an attempt to develop a reading assessment which could 
more adequately assess student achievement of reading comprehension. The 
comprehension itvel Is greatly Influenced by what the student brings to the 
written page In terms of prior experience. Longer reading passages were 
used from the science and literature/reading textbooks appropriate to each 
grade level. 

It appears from the 1982-84 HEP reading and 1983 writing findings, and from 
NAEP's functional literacy assessments In the mid-seventies (NAEP 1976), 
that tne vast majority of America's students are literate readers (close to 
90 percent) and literate writers (probably close to 75 percent). However, 
the fact that ach1e"ement declines have occurred In Inferential 
comprehension and In more difficult writing tasks should be cause for 
concern. It appears that a standard of literacy which was perfectly 
acceptable 10 to 15 years ago Is rapidly becoming obsolete. To the extent 
that analytic. Interpretive and evaluative literacy skills are Increasingly 
demanded by an "Information Society," NAEP findings suggest that there is 
growing illiteracy in complex literacy skills. 

Recent results of HEP reading comprehension tests indicate that there is an 
average of only 50-60 percent correct response rate for student 
comprehension of lengthy passages in science and literature subject areas 
from 1982-84. In addition, recent writing results indicate that only 
3 percent of the fourth grade students, ^2 percent of the eighth grade 
students and 20 percent of the eleventh grade students could write a 
persuasive essay above the minimally developed level. 

Reflecting the philosophy and direction of the btate Board as stated in the 
Outcomes for Student Learning (adopted June, 'i984), the Board endorses the 
concept that a comprehensive language arts curriculum is essential for 
student success in the aevelopment of clear expression and critical 
thinking. Research supports the integration of reading and writing at both 
the elementary and the secondary levels. Reading and writing are 
interactive and fundamentally complementary communication skills. 
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The next stage In the development of the reading assessment also reflects 
the Board's philosophy and direction. The 1985 assessment requires a 
writing assignment response to literature, social studies, and science 
reading passives which will enable us to more accurately assess the 
student's knowledge and comprehension and his/her ability to analyze, 
synthesize and evaluate. With this type of Information, It will be possible 
to more accurately Identify the level of literacy of Illinois students In 
the "Information Society." 



HEP 



Student achievement in reading comprehension was measured at fourth, eighth, 
and eleventh grades with the use of reading passages followed by Inferential 
questions. These reading selections Included literature and science 
subjects In order to simulate the type of reading students are expected to 
do In their classes. Longer reading passages create more realistic memory 
demands on students and allow them to use a greater amount of context In 
responding to questions. 

These reading questions were also used In the 1982 and the 1983 HEP 
assessment. The results show that there Is a decline In reading achievement 
In Expository/Science passages from 1983 and 1984 at all grade levels. The 
declines In the other areas are not statistically significant and are well 
above the 1982 results. 



Table 1.1 Student Achievement In Reading Comprehension 



Type of Reading Passage 



Average Percent Correct 
by Passage 



Average Per- 
centage Correct 



Grade 


style/Subject 


1982 


1983 


1984 


Across Years 


4 


ExposUory/Sclence 


36% 


44% 


40% 




4 


ExposUory/Sclence 


51% 


60% 


51% 




4 


Narratlve/LUerature 


45% 


61% 


59% 






(The Courage of Sarah Noble) 










Average 


45% 


56% 


51% 


50% 


8 


Expository /Science 


64% 


76% 


72% 




e 


Expository /Science 


53% 


63% 


61% 




8 


Narra t1 ve/LI tera ture 












(Great Expectations) 


3"'% 


52% 


51% 






Average 


51% 


64% 


62% 


59% 


11 


Exposi tory/LI tera ture 












(Napoleon, Epic Poem) 


57% 


62% 


61% 




11 


Expos 1 tory/LI tera ture 












(Antigone) 


45% 


56% 


5S% 




11 


Expository/Science 


53% 


69% 


65% 






Average 


52% 


62% 


60% 


58% 
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All of the reading comprehension questions, when statistically analyzed, 
created one factor. This Indicates that the students responded to both the 
science and literature passages with th^ same degree of comprehension. At 
eighth and eleventh grades, the ability of students to read and comprehend 
lengthy reading passages In both scientific and literary subjects appears to 
be fairly stable from 1983 to 1984 but significantly higher than when 
measured In 1982. Significant differences with 1982 were also found In 
grade four. This significant difference Is not modified by scientific or 
literary subject matter. However, at eighth and eleventh grade, the lowest 
comprehensive performance was In complex narrative literature, not on 
scientific material. At fourth grade, the weakest performance was In 
science. 



CHAPTER II 



MATHEMATICS ACHIEVEMENT 

Introduction 

Student achit.-,.<ent in mathematics Is currently O'le of the most studied and 
discussed topics In education. The situation In Illinois Is no different. 
Illinois students have just completed four major assessments of their 
abilities and aptitudes In mathematics. The findings of these studies, as 
well as their comparisons to earlier benchmark data, comprise the major 
content of the present chapter. 

While all of the data necessary for sunmary reports on these four studies 
are not yet available, the picture they describe Is becoming quite clear. 
Illinois students, on the whole, perform neither better nor worse than their 
counterparts In other parts of the United States, but they appear to fall 
farther and farther behind the students of other Induf trial Ized nations as 
they progress through school. 

This chapter reports on statewide, national and International testing data 
which reveal the status of mathematics achievement In Illinois. Four 
studies are described. Three studies have complete findings, while one 
study has only preliminary results available. These four studies are: 

The Second International Mathematics Study 
The Mathematics Decade Study Test: Illinois and Japan 
The Illinois Inventory of Educational Progress 
The Illinois Universities Test of College Preparatory 
Mathematics (Preliminary findings) 

An outline comparison of these four tests Is d^splaiyed In the chart on the 
next page. Specific sections of this chapter will describe each test more 
fully. Generalizations will be drawn In the concluding paragraphs of each 
section. 

The International Association for the Evaluation of Educational 
Achievement (lEA) conducted the Second International Mathematics Stu<ly 
In 1981-82. The University of Illinois at Urbana-Champaign carried out 
the study In the United States. Among test findings of the Second 
International Study are: 

In twelfth grade, the U.S. pre-calculus students (the majority 
of twelfth grade mathematics students) achieve at a level which 
Is substantially below the International mean scores for all 
countries In the Study, and In some cases are ranked with the 
lower one-fourth Internationally. 

In eighth grade, U.S. students dre slightly above the 
international average In computational arithmetic (calculation) 
and well below the International average In non-computational 
arithmetic (e.g., problem solving). 
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OUTLINES OF THE FOUR STUDIES 



Study 
Title; 

Sponsored by: 



Developed by: 



I 

I 



Participants: 



Second Interna- 
tional Ma the- 
matics Study 

International Assoc. 
for the Evaluation of 
Educational Achievement 



Representatives of 
22 countries 



Coordinated by: 



Analyzed By: 



Dr. Kenneth J. Travers 
Univ. of 111. 
(Urbana/Champaign) 

Dr. John A. Dossey 
111. State Univ. 
(Normal, Illinois) 



Illinois, U.S., & 22 
countries 

8th grade: general 
students in 20 countries 
12th grade: 4 yr. 
math students in 14 
countries. 



Mathematics 
Decade Stu^y: 
Illinois & Japan 



Illinois In- 
ventory of Edu- 
cational Progress 



Illinois Universities 
Test of College 
Preparatory Mathematics 



111. State Bd. Ed. 111. State Bd. Ed. 111. State Universities 
Univ. of 111. 
Nippon Electric 
Co., Ltd. 
C & C Systems 
Research Labora- 
tories 

Tokyo, Japan 



Educational 
Testing Service 



111. Inventory 
of Educational 
Progress Staff 
Dr. John A. Dossey 
111. State Univ. 
(Normal, Illinois) 



111. State Universities 
Committee for College 
Preparatory Mathe- 
matics Tests 



Dr. Delwyn Harnisch 111. Inventory Dr. Anthony Peressini 
Univ. of 111. of Educational Univ. of Illinois 

(Urbana/Champaign) Progress Staff (Urbana/Champaign) 



Dr. Delwyn Harnisch 
Univ. of 111. 
(Urbana/Champaign) 



Illinois, Japan 
11th grade students 



11th grade 



Illinois Inventory 
Educational 
Progress Staff 
Dr. John A. Dossey 
111. State Univ. 
(Normal, Illinois.) 

Illinois students 
4th grade 
8th grade 



111. State Universities 
Committee for College 
Preparatory Mathematics 
Tests 



Illinois 11th grfde 
college-bound students 



Time of 

Administration: 
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1981-82 



Illinois: 1981 
Japan: 1982 



1976 

1978 through 1984 



1985 



20 



Since the First International Mathematics Stu4y In 1964, eighth 
grade classes showed a modest decline In end-of-year 
performance on the 36 Items In common between the First 
International Mathematics Stu<ty and the present Second 
International Mathematics Stucjy. The declines were somewhat 
greater for more demanding comprehension and application Items 
than they were for computation Items. 



(Second International Mathematics Study: 
Report, January 1985. pp. 1x-x. ) 



United States Summary 



Three aspects of curriculum were considered when the four tests were 
developed and analyzed. These aspects are described as follows In an 
article by Travers and McKnIght (1985): 

Intended curriculum : The content which schooU Intend to cover In order 

for students to learn specific skills. Intended 
curriculum Is reflected In curriculum guides, course 
outlines, syllabi, and textbooks. 

Implemented curriculum : The content/skills actually covered In classrooms. 

Classroom ob5'»rvat1on, teacher questionnaires, 
homework assignments and teacher-made tests are 
Indicators of Implemented curriculum. 



Attained curriculum: 



Student accompli sh^ient. Test scores, teacher 
evaluations and student projects are measures of 
attained curriculum. 



The Second I nternational Mathematics Study 

The Second International Mathematics Stucly revealed several significant 
facts concerning the status of mathematics learning and achievement In the 
United States, as well as several other countries around the globe. As 
several Illinois high schools also participated In the U.S. sample for the 
study, the data from those classrooms make some comparisons of Illinois 
classes to U.S. and International classes possible. Participating were: 



Australia 

Belgium (French & Flemish) 

Canada (British Columbia 
and Ontario) 

Chile 

England and Wales 
Finland 
France 
Hong Kong 



Hungary 
Ireland 
Israel 

The Ivory Coast 

Japan 

Luxemburg 

The Netherlands 



hiew Zealand 

Nigeria 

Scotland 

Swaziland 
Sweden 
Thailand 
United States 
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The tentative conclusions made from these comparisons must be Interpreted 
with care, as the Illinois classes, whose data were analyzed, were part of a 
larger portion of the U.S. sample of high school classrooms. This set of 
Illinois classes may thus not be entirely representative of Illinois 
secondary school classrooms as a whole. 

Mathematics curricula In the yarious samples were examined at two levels. 
The first level (Population A) was sampled from 20 countries and represented 
the end of compulsory mathematics education for all students. This 
corresponded to the eighth grade level In the United States and Is hereafter 
referred to as the eighth grade test. The second level (Population B) was 
sampled from 14 countr*' unrepresented students who were enrolled in 
mathematics courses Int .u for those Irt the terminal year of a collegiate 
preparatory program. In the United States, this level corresponded to the 
precalcul us/calculus level of twelfth grade and Is hereafter referred to as 
the twelfth grade test. 

Distilled results of the eighth grade study have not yet been made public. 
However, the preliminary United states report indicates the United States 
eighth grade students scored at the 50th percentile overall. Figure 2.1 
shows the typical United States students' position among the 20 countries in 
this study. 

Figure 2.2, adapted from the United States report, shows that the twelfth 
grade U.S. sample scored near the 30th percentile among the 14 participating 
countries. 

When the results of the Illinois twelfth grade classes participating in the 
study are compared with those of t..e United States classes, it is found that 
Illinois students are not significantly different from other United States 
classes. Keeping in mind that the Illinois class scores are unweighted and 
small in number, the data suggest that Illinois' calculus students may be 
marginally stronger than typical United States' calculus students in 
algebra, geometry, elementary functions and calculus, probability & 
statistics, and finite mathematics. Illinois' precalculus students appear 
to be slightly weaker than their counterparts throughout the United States. 

When Illinois twelfth grade classes are compared with their counterparts in 
Japan and at the international level, they, like the United States' aver'q, 
class, score lower than the Japanese classes and the average internatior. ' 
classes. Only in the area of algebra for calculus students is Illinois able 
to match or exceed the average performance level attained by typical 
Japanese classes. Illinois calculus classes compare well with international 
average classes. However, given tnat Illinois cilculus students are a more 
select group of students than is typically found In an advanced twelfth 
grade mathematics class, this is less than impressive. 

The data in Table 2.1 show the differences that exist at the precalculus and 
calculus levels between students in Illinois, the United States, and Japan 
as well as the international mean. In all cases, the Japanese class means 
exceeded the United States class means and the international class means. 
In all but two content areas, the United States calculus class means were 
at, or exceeded, the international mean. This indicates that the best of 
the United States twelfth grade students scored onl^^ slightly above the 
average twelfth grade students participating in the scu<y. 
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Figure 2. I Unltad States' Position Among the 20 Countries 
in the Eighth Grade Study , 
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Figure 2.2 United States' Position Among the 14 Countries 
in the Twelfth Grade Study. 
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The data from Illinois' and United States' classrooms require more study 
before the precise influence of the various factors can be described. 
Nevertheless, two facts are apparent. First, it is clear that the items on 
the tests are not atypical for United States students, and second. United 
States students scored at the 50th percentile in the eighth grade study and 

at the 30th percentile in the twelfth grade study. 
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Table 2J Mean Performance Scores on the Twelfth Grade 

Subtests of the Second International Mathematics Study 



Topics 



Illinois 
Precalculus Calculus 
Sample Sample 



United States 
Precalculus Calculus 
Sample San«pl e 



United 
States 
Total 
Sample* 



Inter- 
Japan national 
Total Total 
Sample* Sample* * 



I 

VO 
I 



Spts/Rpl /Functions 


48% 


63% 


54% 


64% 


56% 


80% 


62% 


Number Systems 


35* 


49% 


38% 


48% 


40% 


70% 


50% 


Algebra 


39* 


64% 


40% 


57% 


43% 


61% 


57% 


Geometry 


3U 


46% 


30% 


38% 


31% 


61% 


42% 


El em. Functions 
and Calculus 


26% 


54% 


25% 


49% 


29% 


68% 


44% 


Prob. & Statistics 


34% 


56% 


39% 


48% 


40% 


72% 


50% 


Finite Math 


23% 


52% 


29% 


38% 


31% 


76% 





*samp1e of all participating students In the country 
♦♦sample of all participating students In the 14 countries 
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The Second International Matheinatlcs Stuc|y (SIMS) began with the development 
of a content grid which Identified Intended curricula and Incorporated 
appropriate content for eighth grade students In the stuc^y. Analysis of the 
various curricula Indicated that the test matched Intended curricula quite 
well, and the Item pool was narrowed to exclude all but the most appropriate 
Items. The same orocess and results were true for the twelfth grade 
curricula and test. Analysis Indicated that over 90% of the sets of Items 
are Included In Illinois' and United States' intended curricula. 

Extensive questionnaires were answered by all teachers whose students 
participated In the SIMS. These responses Indicated two things: the 
Implemented curriculum matched the test reasonably well, and the Implemented 
curriculum did not cover all of the Intended curriculum. 

The plan was to ;eport the data for the twel f th grade International stu<ly as 
a whole and for all participating countries. The composite International 
data are available. However, only the data from the countries of Japan and 
the United States have been made public at this time. 

Table 2.2 shows that In the areas of algebra; sets, relations, and 
functions; and number systems, twelfth grade students In the United States 
receive more coverage than the average twelfth grade students In the 
International sample. However, these United States students ranked below 
the International average In coverage of each of the other tested areas. It 
may be that the other countries' curricula are more advanced In their topic 
coverage and that United States students are covering material from one to 
one and a half years later than students In other countries. In contrast, 
Japanese students had coverage levels which exceeded both the United States 
and International means for every one of the seven curriculum areas. 

Table 2.2 Implemented Curriculum: Percent of Test 
Items Taught In Twelfth Grade Classrooms by Topic 



Test 
Topic 
Algebra 


United 
States 

oil) 


International 
B2% 


Japan 
100% 


Sets, Relations, Functions 


81% 


73% 


95% 


Number Systems 


80% 


76% 


82% 


Analysis 


57% 


77% 


94% 


Finite Mathematics 


56% 


66% 


99% 


Geometry 


52% 


61% 


85% 


Probability, Statistics 


46% 


63% 


83% 


Average 


65% 


73% 


91% 
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A number of explanations for the low United States scores have been 
suggested by members of the National Coninlttee responsible for the Second 
International Mathematics Study In the United States. The most frequent of 
these are: 

United States' curricula are Inconsistent and slow paced In many 
instances; other countries implemei.t rigorous national curricula 
consistently throughout their nation. 

United States' standards and f>xpectat1ons m^y be low in regard to 
previously covered content; ot;.er countries appear to insist that 
students retain whatever was covered in previous years. 

- United States' teachers report that they cover a great mny topics and 
devote similar amounts of time to each topic; other countries appear to 
identify a limited number of topics as essential and spend 
proportionately more time on them. 

- United States' curricula include limited time for measurement and 
geometry; other countries speno considerable time on these content areas 
and emphasize spatial ability almost as much as nimierical reasoning. 

Unitea States' teaching practices emphasize factual knowledge and 
computation; other countries appear to give greater emphasis tt problem 
solving. 

The Mathematics Decade Study Test 

The Mathematics Oecade Study Test is a 60-1tem high school test which 
measures student ability in arithmetic, algebra, geometry, advanced algebra, 
advanced geometry, trigonometry and calculus. 



In the 1981 Illinois student sample of 9,582 eleventh grade students, an 
average of 19.6 correct items were scored on t^.e Mathematics Decade Study 
Test; the 1970 score was 20.9 items correct. In 1982, this same Mathematics 
Decade Study Test was administered to a random sample of 1,700 eleventh 
grade students in Japan. The Japanese sample was designed and drawn by 
Dr. Takahiro Sato, an(? the 60-1tem test was adninistered under his 
direction. Test instructions and items were translated into Japanese and 
then back-translated into English to ensure accuracy. Utmost care was taken 
to render the Japancise test, student sample, and test administration as 
equivalent as possible to the Illinois sample. The Japanese average score 
was 39.6 items correct. 

These results show a substantial yap in mathematics performance between the 
Illinois and Japanese samp''es. The Japanese students averaged 20 more 
correct items on a test which was originally designed for United States 
students. This score is double that cf the Illinois students. 

The sti dents in both the Illinois &?q Japoinese samples were asked for a» ^ 
save their ages. As part of additional analyses, comparisons were made 
between the top 99th, 95th, 90th, 75th, 50th, and 25th percentiles of the 
two samples for each age level reported. Figure 2.3 shows these comparisons. 
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Figure 2,3 

Average Number of items 
Correct for 15, 16, 17 
Year-Olds 



□ Japanese Sample 
O Illinois Sample 



am 



cm 



6m 



0(27) 



0(11) 



AGE 15 



ERLC 



Number 
Of Items N 
Correct 



□ (40» 



Qm 



0(4r 



0<?t) 



0(33> 



cm 



AGE 16 



S0% 



□ts4» g<«» 



□(SOI 



urn 



am 



6(31) 



0(2S) 



0(tt) 



0(H) 



0(l«) 



0(im 



Numbers in parentheses 
are the number of items 
correct at tne note<J 
AGE 17 percentile 



«* n% w% 



-12- 



28 



In each age level and ability level. IlHnols students scored lower than 
their Japanese counterparts. It fs true that the gap narrowed at the 
highast ability level, but this narrowing may have occurred because the 
Japanese score nay have been constrained by a "celling effect." A celling 
effect occurs when most test scores being considered are near the highest 
possible score. 

United States' scores on the First International Mathematics Stu<(y led Husen 
to do a secondary analysis of the stu^y. He had observed that some 
countries had an elitist educational system while others (like the United 
States) attempted to educate all children. He conjectured that if only the 
top percentiles of each country were compared. United States scores would 
equal those of other countries. Husen's analysis (1983) showed eight 
countries above the United States and three countries below the United 
States. Frcm this Husen concluded that the "top « of United States 
students' scores are at about the same level as the corresponding group in 
the other countries" (p. 460). With Husen's stu<(y in mind, the Decade Stud|y 
comparison with Japan considered the educational policies of both countries. 

Since Japan now has the comparable policy of educating all students through 
high school, a further scrutiny was made to compare the "holding power" of 
Japan and Illinois. "Holding power" is the percentage of entering high 
school freshmen who graduate from high school. As far as can be determined, 
nearly all students in both Japan and Illinois enter high school. Holding 
power in Japan is 90%; in Illinois, 75%. Both samples were then scrutinized 
to determine whether either san:ple contained a disproportion of low 
achieving schools. It appears from this scrutiriy that both samples are 
representative of their respective populations. 

Japan's educational systen. .las been studied by many American scholars in the 
past ten years. Walb** - (1983, 1985), Harnisch (1984), Cuinnings (1980), and 
Easely (1983) have reported results similar to the discussions of the United 
States' Conmittee of the Second International Mathematics Study. The 
recurring themes are: 

Japan is a homogeneous society whose upper classes are not unusually 
different from its lower classes; the United States is a heterogeneous 
society with large differences among classes. 

- Japan has a national curriculum with high standards and challenges all 
students to meet those standards; the United States has disparate 
curricula and strives to meet the needs and interests of widely varying 
students. 



Japanese education Includes a 240-day school year. Intense family 

involvement in children's education, and a 2-3 hour "juku" 

(school -after-school) every d«y for marv children; the United States has 

a 176-day school year with little Involvement by many families and no 

school -after-school. By eleventh grade, Japar.^se students have 3 1/3 

more U.S. school years (64 more school days per year) than their U.S. 

counterparts. 
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The minols Inventory of Educational Progress 



The Illinois Inventory of Educational Progress (HEP) was instituted as the 
testing program of the Illinois State Board of Education in 1976 and has 
tested fourth, eighth and eleventh grade students in mathematics every year 
since then except 1977. The 1984 HEP tested students in general 
mathematics and geometry. Results reported here come principally from the 
1984 HEP 9 but comparative results of previous years are included to give a 
fuller context. 

Detailed results of analyses of data gathered from the 1984 HEP will be 
given in the curricular report to be published by the Illinois State Board 
of Education* Generalizations from preliroinat7 analyses can be presented 
from three perspectives: Illiv^ois trends in mathematical achievement, 
relative levels of competence, and development of rathematical ability. 
These perspectives are subdivided as follows and tnen discussed. 

Illinois Trends in Mathematical Achievement 

* Trends In general mathematics 

* Trends for mathematical topics 

Relative Levels of Competence 

* Comparison of rote knowledge with problem-solving ability 

* Caparison of general mathematics with geometry 
Comparison of rote knowledge in arithmetic and geometry with 
problem-solving ability in arithmetic and geometry 

Development of Mathematical Ability 

* In general mathematics 

* In geometry 

* Abilities underlying success on the HEP 
I'ilincis Trends in Mathematical Achievement 

One of the primary goals for the HEP program is to provide an ongoing 
picture of student achievement patterns in basic areas of the school 
curriculum. As part of this effort, the HEP mathematics tests have offered 
a common set of items to students over the years in an attempt to discern 
trends in student performance on these items. These items have been 
carefully selected on the basis of stability, ability to discriminate, arid 
relationship to central areas of the school currici'lum. 

The graphs in Figure 2.4 Illustrate the results from the use of these items 
from 1976 to the present. Performance on the items in 1984 cause concern. 
Drops at the 4th and 8th grade levels from 1983 are statistically 
significant and bring performance levels to one of their lowest points since 
the inception of the trend item comparisons, while performance at the 11th 
grade level equals the highest ever recorded on the HEP. 
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ILLINOIS INVENTORY OF 
EDUCATIONAL PROGRESS 
Figure 2.4 Trends in Mathematics 




Review of the Item responses and Item types from the trend Item set did not 
provide a ready explanation for the decrease In scores at the fourth and 
eighth grade levels. Student performance on these Items In the 1985 HEP 
will be studied carefully. 

Performance has been charted each year on the Illinois Inventory of 
Educational Progress for various mathematical topics. Although the number 
of Items per topic Is small and thus warrants caution, the consistency of 
student performance In regard to each topic Is significant. The 1984 data 
were consistent with every previous data set. Results Indicate that student 
performance at all three grade levels Is highest In whole number computation 
and lowest In measurement and geometry. The rank order of performance for 
the various topics Is: whole number computation; mathematical concepts; 
application; fractions, decimals, and percents; prealgebra; measurement; and 
geometry. 

Relative Levels of Competence 

Despite the fact that sets of rote knowledge Items and sets of 
problem-solving Items were matched for the average student's ability, 
student performance was higher on the rote Items than on the problem-solving 
Items. Table 2.3 displays the comparisons. 

Table 2.3 Comparisons between Rote Knowledge and Problem-Solving 

Skills on the 1984 HEP 



MEAN SCORES 

Grade Level Rote Knowledge Problem Solving Difference 

4 56% 45% 11% 

8 63% 38% 25% 

11 64% 51% 13% 



Rote knowledge was also compared with problem solving In 1982 and 1983. 
Those patterns were Identical to 1984. Performance Is higher when only 
memory Is needed than when thinking Is also required. 

The data In Table 2.4 show that student performance Is higher In general 
mathematics than In geometry. 

Table 2.4 Comparisons between General Mathematics 
and Geometry on the 1984 HEP 

MEAN SCORES 

Grade Level General Mathematics Geometry Difference 



4 59% 35% 24% 

8 57% 39% 18% 

11 58% 50% 8% 
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student performance in geometry Is clearly lower than In general 
mathematics. However, students are given little or no exposure to geometry 
by fourth grade, some exposure to It by eighth grade, and still more 
exposure by eleventh grade. Analyses are now underway to determine the 
extent to which exposure accounts for the differences In performance. 

What happens If the preceding two sections are put together? It appears 
that a pattern develops which Is more closely related to the type of mental 
ability required than to the type of mathematical content In the test Item. 
The rank order of performance Is: 

rote knowledge In general mathematics 
rote knowledge In geometry 
problem solving In general mathematics 
problem solving In geometry 

The pattern Js broken In fourth grade where Mttle geometry Instruction Is 
given. And, eleventh graders appear to have an equal amount of rote 
knowledge In general mathematics and geometry. Table 2.5 displays the data. 

Table 2.5 Patterns In Rote Knowledge and Problem Solving 
for General Mathematics and Geometry 

Factual Knowledge Problem Solving 

General General 
Mathematics Geometry Mathemati cs Geometry 

Grade 4 63* 43* 56* 291 

Grade 8 67% 55% 45% 33% 

Grade 11 64% 64% 57% 46% 

These data correspond closely with the comparisons made earlier about the 
amount of geometry covered In the school curriculum. They also appear to 
Indicate the strong computational character of our mathematics curricula 
across the grades. 

Questionnaires were sent to every school which participated In the HEP. 
Teachers were asked to answer these four questions for every Item on the 
general mathematics and geometry tests: 

To what extent have students been exposed to the content of this Item? 
How well does this Item measure the content you are teaching? 
- How difficult Is this Item? 

What percentage of your students will get this Item correct? 

Teachers reported that the students had been adequately exposed to the 
general mathematics test Items, that these Items measured the content very 
well, and that most of the Items were toward the easy side of the sca'^e with 
only a few rated moderately difficult. Table 2.6 shows the overall averages 
of teacher estimates and actual student performance for the general 
mathematics tests. 



ERIC 



-17- 33 



Table 2.6 Teacher Estimates and Student Performance 
-in General Mathematics 



MEAN SCORES 



Grade 


Teacher 
Estimate 


Student 
Performance 


Difference 


4 


63% 


60% 


+3 


8 


68% 


57% 


+11 


n 


62% 


59% 


+3 



Geometry test responses were s1gmf<c2ntly different. Fourth grade students 
had generally not been exposed tc the content at all, while eighth and 
eleventh grade students had been. Teachers Judged the fourth grade test to 
be somewhat difficult overall; the eighth grade test to be average; and the 
eleventh grade test to be somewhat easy. Table 2.7 displays the averages of 
teacher estimates and actual student performance for the geometry tests. 

Table 2.7 Teacher Estimates and Student Performance 
on the Geometry Tests 

MEAN "CORES 



Grade 


Teacher 
Estimate 


Student 
Performance 


Difference 


4 


27% 


36% 


-9 


8 


46% 


40% 


+6 


11 


60% 


51% 


+9 



uevelopment of Mathematical Ability 

Comparisons In general mathematics across grade levels heve been very 
difficult within any given year. Items that are reasonaLOe at one grade 
level are usually too easy or too difficult at another. However, we now 
have enough data across years to take an Initial look at the growth patterns 
of students as they progress through school. This Initial look comes from 
an analytic approach called cohort analysis. A "cohort" Is a group of 
students entering school In a specific calendar year and continuing through 
the succeeding grades together. The HEP has been able to chart the 
complete progression of only one cohort so far. This cohort, born In 1965, 
entered kindergarten In 1971 and took the fourth grade HEP In 1976, the 
eighth grade test In 1980, and the eleventh grade test In 1983. Table 2.8 
shows the cohort comparisons. 
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Table 2.8 Comparative Trend Scores for Students on the HEP 

Test Year Grade 4 Grade 8 Grade 11 

1976 55 .. 60 ^ 50 

1977* * ^ 

1978 
1979 
1980 
1981 
1982 
1983 

1984 61 
^■trend Item set not administered 

Two growth patterns In the table have sufficient data to scrutinize for 
patterns. The dotted lines compare cohorts in their progress from fourth to 
eighth grade. The pattern Is not clear. Some cohorts appear to Improve 
while others appear to decline. 

A more consistent pattern occurs In the transition from eighth to eleventh 
grade. The trend seems to be a decline In mathematical achievement during 
the students' high school years. The decline for the average student may be 
more pronounced than the table appears to Indicate. For students who pursue 
the college preparatory sequence of mathematical courses In high school, the 
likelihood U that tht?y would score quite well on the HEP thus raising the 
state average. Other eleventh grade students would have to score 
considerably below what they did as eighth graders to depress the cohort 
average below Its eighth grade level. 

Seven Identical geometry Items were Imbedded In all three grade level 
geometry tests, thus allowing for study of student growth. Table 2.9 shows 
the data on these Items. 



Table 2.9 Cross-Grade Comparisons In Geometry 
Mean Scores 

Grade Levels Gains 

4 8 11 4-8 8-11 4-11 

33% 53% 67% +20 +14 +34 

Considerable gain is made in knowledge of geometry ar students progress 
through school: 34 percentage points from fourth to eleventh grade. An 
additional set of three items was found to be reasonable for both fourth and 
eighth grade students, and twenty- two additional items were found to be 
appropriate for both eighth and eleventh grade students. The gains for 
thesp sets confirmed the results displayed in Table 2.9. 
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Complex statistical analyses n^re undertaken to Identify those abilities 
which contributed most to successful student performance on the HEP. 
Results Indicate that mastery of mathematical concepts Introduced at the 
grade level tested, coupled with the ability to solve problems requiring use 
of those concepts, produced the highest scores. 

Table 2.10 shows the most Important of these skills and concepts by grade 
level and test. 



Table 2.10 Most Important Concepts and Skills for Success on the HEP 
Grade 

Level General Mathematics Geometry 

4 An understanding of number and Knowledge of basic terms in 

nume ra t1 on geometry 
Skill In computation An understanding of perimeter 

w^th whole nimibers 

8 An understanding of percentage Knowledge of basic terms In 

An understanding of estimation geometry 
Skill In computation with fractions An ability to solve slctple 
Skill In computation with decimals geometry problems 

Ability to solve problems not 
usually found In textbooks 

11 An understanding of basic algebra Knowledge of basic terms In 
An ability to solve word problems geometry 
An ability to work with percent An understanding of basic 

relationships In geometry 
An ability to solve problems 
Involving area and volume 

The descriptions given In Table 2.10 point to the need for both factual 
knowledge and problem-solving ability. These data would not appear to 
recommend a concentration on problem solving to the exclusion of factual 
knowledge, nor the opposite. Rather, the question appears to be: how can 
students best be helped to acquire both? 

The Hllnols Universities Test of College Preparatory Mathematics 

The Hllnols Universities Test of College Preparatory Mathematics Is 
designed to provide a diagnostic measure of proficiency In a variety of 
mathematical skills essential to success In college-level programs requiring 
high school mathematics. This examination Is divided Into two segments: 

1) A two-part main examination designed to produce subscores In elementary 
algebra, geometry, and first-semester advanced algebra. 

2) A trigonometry and second-semester aovanced algebra examination which 
can be given at a later date than the two-part examination and Is scored 
locally with the help of an examination key and sample solutions. 
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These tests are designed to be given to college-preparatory students In 
their junior year so they will have their senior year to correct any 
deficiencies which may be Identifier*. 

The Illinois Universities Test of College Preparatory Mathematics was 
developed on the basis of abilities needed to be successful In college 
mathematics courses. Thus, Intended curriculum was defined by the 
university mathematics professors as what the high school curriculum should 
be. This went beyond the usual approach to Intended curriculum. I.e., the 
description of what teachers Intend to teach. And, It Identified what 
should be required for success at the next higher level. 

Developers of the Illinois Universities Test of College Preparatory 
Mathematics made no formal assessment of high school curricula or content 
coverage. Assessment of Implemented curricula was limited to a critique of 
the test by selected high school mathematics teachers. 

The Illinois Universities Committee for College Preparatory Mathematics 
Tests releases only diagnostic results which are sent to the participating 
schools for the benefit of Individual students. This makes measurement of 
attained curriculum on a wider basis Impossible. However, the committee has 
noted that only a small percentage of Illinois high school students are 
progressing at a rate which will adequately prepare them for college-level 
mathematics courses by the tir they graduate from high school. 



Conclusion 

Mathematical achievement has recently been called a problem of national 
concern. Results of the Second International Mathematics Study and the 
Mathematics Decade Stu<l^; Illinois and Japan add further evidence to the 
widespread perception tnat education in the United States Is of considerably 
lower quality than concerned citizens would like It to be. 

Data from the Second International Mathe.Bat1cs Study (SIMS) and the Decade 
Study Test; Illinois and Japan contradict earlier evidence that the best 
mathematics students In the United States are equal to the best In any other 
country. Instead, the best mathematics students of many nations clearly 
surpass the best Illinois and U.S. students. 

Data from the .SIMS also show that Illinois students fall farther and farther 
behind the students of other nations as they progress through school . By 
eighth grade, Illinois students ranked at the 50th percentile; by twelfth 
grade, Illinois students slipped to the 30th percentile. 

The 1984 Illinois Inventory of Educational Progress (HEP) results, together 
with SIMS results. Indicate that Illinois students are especially weak in 
geometry, measurement and problem solving. Results from the SIMS also show 
that students' problem-solving skills have declined significantly in the 
past twenty years. 
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New findings on factors which affect student achievement In mathematics, 
combined with findings from earlier studies. Indicate that student 
time-on- task cannot be considered In Isolation. Levels of a system's 
expected outcomes, a school's currlcular objectives, and the students' 
efforts to meet these expectations must also be taken Into account. 
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CHAPTER III 



SCIENCE ACHIEVEMENT 



The latest report from NAEP (National Assessment of Educational Progress) on 
science has supported the contention that there are serious problems in the 
conduct of science programs in the schools. Reporting data from 1931, it 
concluded that there was a general decline in science performance across the 
content tested at all grade levels. 

That conclusion is not totally supported by the data from the most recent 
Illinois Inventory of Educational Progress Science Assessment. Student 
performances are either stable or somewhat improved for the science topics 
tested and for all grade levels in the assessment plan. Students in fourth 
grade performed notably better on the 1984 Science Assessment than did 
fourth graders in .81. Performances at eighth and eleventh grades were at 
approximately the same level in 1984 as they Kc?re in 1981. The following 
figure summarizes those results. 



In addition to presenting these test results as total scores, the same items 
are also grouped as seven subtests to characterize student performance in 
content and skill areas. Students performed well in a number of the content 
and skill areas included in the Science Assessment when compared with 
performances in the same areas four years earlier. Significant gains are 
apparent in a number of areas. Improved performance occurred for life 
science at each grade level. Fourth and eleventh grade student perfomance 
on items dealing with higher order thinking skills and scientific processes 
also improved. Eleventh grade students also did better in 1984 than in 1981 
on items dealing with earth science. 

A second way of reviewing these results is to compare the 1984 averages for 
each of the subtests to the average performance on the entire test for the 
same year. That comparison indicates which of the subtest aroas fell above 
or below the average. 



Figure 3.1 . 1981-1984 Differences in Science Achievement 
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Fourth grade students scored above the test average for earth science Items 
and Items calUng for recall of knowledge or comprehension; eighth grade 
results were above the test average for life science, physical science and 
Items covering the higher order thinking skills of analysis, synthesis and 
eva'iuatlon; and eleventh grade students did well on life science Items as 
well as the types of Items dealing with higher order thinking skills. The 
subtest areas where students scored significantly below the average for the 
entire test Included physical science at the fourth grade level; earth 
science, the nature of science, and knowledge and comprehension at the 
eighth grade level; and earth science and knowledge and comprehension at the 
eleventh grade level. 

This chapter presents Information about the performance for each grade level 
assessed within each of these subtest topics for the 1984 assessment (see 
Tables 3.2 and 3.3). Performance Information Includes comparisons of 
students In the 1984 assessment to students In the 1981 assessment when 
virtually the same questions were aMnlstered. (See Tables 3.4 and 3.5 for 
year to year comparisons of content and skill area performance.) Growth of 
student performance from grade level to grade level Is also documented. The 
performance of eighth arade students from 1981 as eleventh grade students In 
1984 Is also Included (refer to the cohort Information In Table 3.1). 

In addition to achievement results, sections of this chapter describe 
conditions that Influence student achievement. These sections depict 
setting characteristics, attitudes and values about science reported by 
students and school staff. 

The Nature of the Science Assessment 

The Illinois Inventory of Educational Progress Science Assessment was 
designed to test student performance both In content areas and In areas of 
cognitive skills applied to science. The content considered for the test 
Included Life Sciences, Physical Science, Earth Science, Scientific 
Processes, Technology and Science, and The Nature of Science. The content 
of the test varied from grade level to grade level. At fourth grade, 31 
Items covered all content areas except Technology and Science and the Nature 
of Science. Forty-one Items at eighth grade and 46 Items at eleventh grade 
touched upon all of the content areas. 

Those same Items are also categorized according to cognitive skills as 
schematlclzed In the Taxonomy of Educational Objectives edited by Benjamin 
Bloom (1956). That taxonony provides a range of cognitive abilities from 
simple to complex whL^h Include knowledge, comprehension, application, 
analysis, synthesis, and evaluation. For the purposes of the Science 
Assessment some of the skills were grouped together. Knowledge and 
comprehension of content formed one group tested by 8 Items at fourth grade, 
15 Items at eighth grade, and 18 Items at eleventh grade. Application of 
scientific knowledge In content areas was tested by 16 Items for fourth 
graders, 15 Items for eighth graders, and 17 Items for eleventh graders. 
The remaining skills— analysis, synthesis, and evaluation (sometimes called 
higher order thinking skills )— were tested by 7 Items, 11 Items, and 11 
items at fourth, eighth, and eleventh grades, respectively. 
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The Intent of the test developers was to provide a test eiiiphastzjng the 
practice of science, not science as Information obtained largely through 
reading. In this sense, the Illinois Inventory of Educational Progress 
Science Assessment Is as much a test of how well students think as It Is a 
test of how much specific Information students remember. This presentation 
of achievement results will reflect the content and skills outlined above. 

Life Science Results 

The Life Science Items In the test decU with the subject matter coranonly 
taught under the title of Biology, other courses where such Information 
might also appear are Ecology or Environmental Studies. The Items In this 
area reflected /nformatlon dealing with living things. Not only were living 
org&.ilsms considered separately, but also as groups or systems. Items 
examined student understanding of the relationships anong Individuals, 
groups, systems, and their envlronrnent. For example, one of the Life 
Science assessment Items asked students about the components of cells at the 
knowledge and comprehension level of skill, while another Item, at the 
higher order level of skills asked students about the conditions necessary 
for seeds to sprout and grow. 

Results at all three grade levels Indicate that students did well on the 
Life Science Items (Figure 3.2 j. Performance on each Item li, this area was 
ofte;i above performances from that of three years earlier. In addition, 
performance on these Items was either at or above the average for the test 
aft a whole. 

^^^ure 3.2 1)81-1984 Differences In Life Science Achievement 





Fourth grade performance for 1984 averaged 57.4% correct on the Life Science 
Items and 55.4« correct for the entire test. This result was a significant 
Improvement In performance over 1981 when the typical Life Science Item was 
answered correctly by 52,6$ of the students. 

At eighth grade, Life Science performance vas significantly higher than the 
average performance for the whole test In 1984 and the Life Science 
performance In 1981. Eighth graders answered the Life Science Items 
corrects at a rate of 68.8S. (The test staj.-lard was 60.8% In 1984 and the 
Life Science average In 1981 was 64.5%.) 
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similarly, eleventh grade students performed significantly better In 1984 
than they did in 1981. An average of 78% of the present day students 
responded t& Items correctly compared to 74.6% of the eleventh graders In 
1981. That performance was also significantly higher than the performance 
for the average proportion correct on the entire 1984 exam— 66.8% correct. 

Physical Science Results 

The cbiitent area of Physical Science Is most closely related to courses 
labeled as Physics In schools. Although Physics Is most often thought of as 
a high school course, many of the concepts and processes related to the 
physical world around us are Included In the content of science at lower 
grade levels too. The Physical Science assessment Included on the Illinois 
Inventory of Educational Progress IncluJed knowledge-oriented questions 
about such matters as the freezing point of water In terms of Celsius 
tcinperature. More advanced knowledge was needed to answer a question about 
cloud seeding. In addition, higher order thinking skills were tested 
through questions about the density of floating objects and evaporation. 

Although Physical Science results from 1984 are slightly higher than they 
were In 1981, the differences are not statistically significant. Figure 3.3 
summarizes the data. 

Figure 3.3 1981-1984 Differences In Physical Science Achievement 



Performances for fourth graders In 1984 are statistically similar to 
performances on the 1981 assessment. Regardless of the stable performance, 
fourth grade results for the Physical Science Items are below the average 
Item on the entire test. An average of 47.5% of the students answered the 
Physical Science Items, correctly, while the average for th-? entire test was 
at 55.4% correct. 

The performance for eighth graders In ^<»84 was also very similar to 
performances on the 1981 assessment. Wiiile the year to year comparison for 
eighth graders Is similar to the fourth grade performance, the eighth 
graders did not find the Physical Science Items to be as difficult as the 
fourth graders. The Physical Science results at the eighth grade level for 
1984 are significantly higher than the average for the entire test which Is 
60.8% correct. 

The 1984 eleventh grade performance Is also similar to the 1981 
performance. The 1984 result Is not significantly different from the 
average for the entire test. 
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Earth Science Resul ts 



The content area of Earth Science Is closely related to Geology. Knowledge 
of the "mountain building" dynamics of the crust of the earth was Included 
In one of the lower-level cognitive skills Items tested. More complex 
cognitive skills were called for In questions about erosion and rainfall 
P'tterns related to geographic features. Figure 3.4 summarizes performance 
results comparing 1981 to 1984 In this area. 

Figure 3.4 1981-1984 Differences In Earth Science Achievement 



Fourth grade students found the Items covering the Earth Science topics to 
be easier than the average 1t«n on the test. The average score of 66.1% 
correct for Items dealing with Earth Science was slightly more than 10 
percentage points better than the 55. 4S averag? for the entire test. Since 
the fourth grade students from three years ago also did well In this area, 
there was no significant difference between performances In 1981 'id 1984. 

By contrast, eighth graders found Earth Science Items to be more o ♦'ficult 
than the average Item on the test at that level. Eighth grade students 
scored nearly 10 points below the 60.8% test average at 51.9% correct for 
the Earth Science Items. Those scores were similar to those from four 
years earlier In Earth Science. 

For eleventh graders too, che Items were more difficult than the other Items 
on the test. In spite of that, however, the result Vds a significant 
improvement over the 1981 result. In 1984, eleventh grades averaged 64.9% 
correct for Earth Science items while their average for the entire test was 
69.4%. Earth Science performance in 1984 was 5.4 percentage points better 
than the 59.5% correct in 1981. 
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Scientific Processes Res;:1ts 



Less traditional content than that previously described Is Included In the 
Illinois Inventory of Educational Process Science Assessment area labeled 
"Process." Scientific processes Include scientific methods and applications 
or logical analyses of problems amenable to scientific experimental 
examination. These "Process" Items are designed to discern how well 
students know about or use skills related to doing science. Without such 
knowledge and skill, the real work of sc ance could not be accomplished. 
This area represents a dividing point between students who will simply 
appreciate science as opposed to those who could become practitioners of the 
craft. Performance on "Process" items shows an Improvement over the 1981 
test results for each of the grades in the assessment (Figure 3.5). 

Figure 3.5 1981-1984 Differences in Scientific Processes Achievement 



Fourth grade students responded correctly 55 J % of the time for "Process" 
items and 55.4% for the entire test. Although it is a performance 
comparable to the average for the test, it represents a signifioint 
improvement over the 1981 performance of 50.8% correct. 

Eighth graders perfonm d at 59.3% correct on "Process" items and 60.8% for 
the entire test. This was not significantly above the 1981 level of 56.4% 
correct on the average. 

Eleventh graders also scored near the average for the entire test on the 
Process items. That result was 72.2% correct for the Process items and 
69.4% correct for the test. The 1984 result was, however, significantly 
higher than the 1981 result of 67.5% correct. 

Nature of c>c1ence Results 

The Nature of Science was t ested at eighth and eleventh grades on the 1984 
Science Assessment. The ' >s Included under that title do not reflect any 
of the traditional subjecv .;iatter classifications that most people remember 
as part of the school program. Rather, the nature of science category is 
characterized by answering such general questions as: What is science? 
What does a scientist do? And what are the 1mpl1c£u1ons of doing science? 
Such matters m^^y be touched upon in each of the science classes provided for 
students. Lower cognitive level items on the Science Assessment called for 
a true characterization of the information produced by scientists while 
higher cognitive skills applied to this category called for an Inference 
about the unexpected or ser3Pdip1tous phenomena sometimes discovered in the 

practice of science. Overall performance results between 1981 and 1984 are 
compared in Figure 3.6. 
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Figure 3.6 1981-1984 Differences in Nature of Science Achievement 



Eighth grade students found the Nature of Science items more difficult than 
the average items on the test. Their average of 50.9* correct was nearly 10 
percentage points below the test average of 60.8% correct. That performance 
was similiar to the 1981 test results for this area. The stability of the 
score over time resulted in the lower comparative performance while other 
areas improved. 

Eleventh grade students, on the other hand, performed at about the same 
level for the Nature of Science items as they did for the test as a whole. 
They answered Nature of Science items correctly at an average of 67.4% 
correct compared to the 69.4% correct for the entire test. The Nature of 
Science results from 1981 were similar to this. 

Knowledge and Comprehension Results 

The skills tested as Knowledge and Comprehension relate to specific recall 
of knowledge, deciding what alternative represents an accurate "translation" 
of an idea or concept; reordering ideas, or extending those ideas or 
concepts as a trend. While knowledge and comprehension are often considered 
to be among the "lower order" cot^nitive skills, that designation in no way 
is intended to reflect the difficulty of test items falling into this 
classification. One only has to reflect upon the types of questions 
collected for games of trivia to appreciate the potential difficulty of such 
items. Indeed, for students at the two upper grade levels, the knowledge 
and comprehension items were more difficult than the average. For example, 
only about half of the eighth and eleventh graders taking the test were able 
to identify "tissue" not to be a component of a cell. A comparison of 1981 
to 1984 results, however, show student performances to be at roughly the 
same levels. (See Figure 3.7.) 
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Figure 3.7 1981-1984 Differences 1r» Knowledge 
and Comprehension Achievement 




Similar to the 1981 students, the 1934 fourth grade students answered Items 
correctly at a rate about the same as the average test item In 1984. For 
that test administration, students averaged 61.4% correct for items In this 
category and 55.4% for all Items on the test. 

While an average of 60.8% of the eighth grade students responded correctly 
to items on the test, the average for the Knowledge and Comprehension items 
was significantly lower. For that subgroup o^ items, 56.8% of the eighth 
graders responded correctly. That performance was comparable to the 1981 
average for knowledge and comprehension. 

Elev rade students also found the Knowledge and Comprehension items to 
be more difficult than the average while performing as .2V as students in 
1981. While their average for items for the total test was 69.4% correct, 
their average for Knowledge and Comprehension items was 61.0% correct. 

Application Results 

The type of skill Included as Application in Bloom's Taxonomy is more 
complex than knowledge or comprehension. In science applications, for 
example, the student would be expected to apply knowledge, methods, 
theories, or principles to tasks, problems, or situations new to the 
student. In the 1904 Science Assessment, Application items dealt with 
reading the temperature on a thermometer or applying the Piagetian concept 
of "conservation" in selecting one diagram from a set of diagrams 
illustrating the concept. At all grade levels Application items were of 
about the same difficulty as the average for the entire test. Those results 
were similar to student performances in 1981 (Figure 3.8). 
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Figure 3.8 1981-1984 Differences in AppH cation Achievement 




Fourth grade students answered Application Items at a rate of 53.1* 
correct. The total test average was 55.4% correct. The difference Is not 
significant. 

Eighth grade students performed at virtually the same rate for both 
Application Items and the Items for the entire test. Their Application 
performance obtained a 60. 9t correct response while the test results were 
60. 8X correct. 

The 1984 eleventh grade students performed Just slightly above the 1981 
students on Application Items. The difference, however. Is not 
significant. The 1984 results were 71.11 correct and the »*esults for the 
entire test were 69.4% correct. 

Analysl s/SynthesI s/Eval uati on Resul ts 

Higher order thinking skills are often depicted as relating to analysis, 
synthesis, or evaluation. Analysis consists of Identifying the components 
and relationships between components In something under study. Synthesis 
entails taking disparate elements and putting them together In a new and 
reasonable manner. Evaluation, In a formal sense, consists of determining 
Internal consistency or correspondence to external standards. 
Analysl s/Synthesls/Eval uati on Items Included having students use Information 
from a narrative and a diagram to arrive at an appropriate conclusion. For 
such skills, students performed at least at the average for the entire 
Science Assessment or better. Further, student performances were 
significantly Improved over performances In 1981 In two of the three grade 
levels tested. The differences are depicted In Figure 3.9. 
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Figure 3.9 1981-1984 Differences in 

Analysi s/Synthesi s/Eval uati on 
Achievemdnt 




Fourth grade students' performance in Analysis/Synthesis/Evaluation was 
about the same as their performance on the test as a whole. Yet that 
performance was sigrificantly improved from 1981. Fourth graders averaged 
55.4% for the entire test, while their Analysis/Synthesis/Evaluation average 
for 1984 was 53.7% correct, an 8-point gain from the 1981 average of 45.7%. 

The 1984 eighth grade performance in this area was significantly above the 
average performance on the test, yet similar to the 1981 result. Eighth 
graders scored 66.1% correct for Analysi s/Synthesis/Evai nation and 60.9% 
correct for the test as a whole. 

Eleventh graders were above average in performance for this category of 
Items. Their Analysi s/Synthes<s/Eval uati on average was 80.4% correct, while 
their total test average was 6^.4% correct, an eleven point difference. 
That performance was significantly higher than the average of 76.9% correct 
from 1 981 . 

Cohort Comparison Results 

The 1984 administration of the Science Assessment was the second time the 
Illinois Inver.cory of Educational Progress included this subject area. The 
previous achnini strati on was in 1981. This three-year cycle allows the 
results from the eighth graders of 1981 to be compared to the results from 
the eleventh graders of 1984 as they are the same group of students moving 
through the educational system. The comparison is further facilitated by 
the design of the test. Thirty-six of the same items are taken both by 
eighth and eleventh graac students. 
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The eighth graders of 1981 performed slightly below, but about as well as, 
the present day eighth graders on these Items. As eleventh graders In 1984 
those eighth graders are performing slightly, but not significantly, above 
the eleventh graders of three years ago. Three years ago the eighth to 
eleventh grade difference was 10.2 percentage points. In 1984 the 
difference was 11.0 percentage points. The difference between the eighth 
graders of 1981 and the eleventh graders of 1984 Is 12.8 percentage points. 
Strong subtest differences In Life Science and Scientific Processes Items 
contributed to this gain. (See Table 3.1.) 

Table 3.1 Cohort Comparisons 



Grade Year Grade Year Differences 

8 IW 11 1981 + 10.2 

8 1984 11 1984 + 11.0 

8 1981 11 1984 + 12.8 
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Students and Science 

It Is readily apparent that the experiences students have outside of school 
Con contribute to performance In school and on tests. The 1984 Illinois 
Inventory of Educational Progress gathered Information about science 
experiences from students through a questionnaire Included with the Science 
Assessment. This section describes the questionnaire results. 

Student Involvement In Science at School 

Previous studies associated with the Illinois Inventory of Educational 
Progress have shown that the number of courses a student has taken In a 
subject area Is an Important Indicator of how well a student will perform on 
tests such as the Science Assessment. Obviously, If a test relates to 
subject matter of optional classes, as In the case of mar^ high school 
science courses, the average performance on a test will be Influenced by the 
proportion of students not taking the course. At elementary and middle 
schools, the number of students who reported not having science as a subject 
of stucty Is small. The analyses presented In Chapter IV demonstrate the 
significance of this Information In predicting student test performance. 

At the fourth grade level, 72.7% of the students reported they had 
participated In a science class more recently than the previous semester. 
An additional 18% had science sometime during the year. This totals 90.7% 
of the fourth graders with experiences In a science class relatively close 
to the time they too!, the Science Assessment. A larger portion of eighth 
(89.2%) than fourth graders had science class near to the time they were 
asked to perform on the Science Assessment. A total of 95.6% of the eighth 
graders had science at least during the previous semester. The least amount 
of exposure Is found among eleventh grade students where science Is 
predominantly an elective course. At that grjde level, only 30.7% of the 
students reported they were enrolled In science during the semester they 
took the Science Assessment. An additional 6.4% had been enrolled during 
the previous semester. In addition to this Information, Juniors were acked 
to report the number of semesters of science they had during their high 
school career. The most common pattern for eleventh graders was one or two 
semesters of sclenca. This was reported by 41.3% of the students. An 
additional 25.8% reported three or four semesters of science. 
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Science In the Home Environment 



Home environments contribute to student performance In science. (See 
Chapter IV for the analyses depicting the extent of this contribution.) 
Parents certainly may be role models for their children. As an Indicator of 
home conditions thav could provide a favorable environment for student 
Interest or work with science, one question asked If either of the student's 
parents worked In a science-related area such as medicine, chemistry, or 
research. Close to the same proportion of students at each grade level 
Indicated that their parents had science-related work. This suggests that 
the self-reported Information Is accurate or at least defines a probable 
range of results. At fourth grade, 16.5%; at eighth grade, 15.4%; and at 
eleventh grade, 13%»a range of 13 to 17%-- of the home environments Include 
a parent Involved In a science-related occupation. 

Students as Science Consumers and Doers 

The experiences of students as consumers of science-related Information and 
as actively engaged In science can form a significant Influence In the 
knowledge and skills of a student. Exposure friformatlon In Chapter IV 
Illustrates the Importance of these experiences for achievement. Questions 
related to consumerism asked students about their science reading and 
television viewing habits. The questions dealing with Involvement asked If 
students talk with parents about science (a low level of Involvement) or If 
they did science projects for themselves (a high level of Involvement). The 
results show that both science consumerism and Involvement decline as 
sti'dents get older. 

While approximately half of the fourth grade students read books about 
science during a month, that proportion drops to about 40% at eighth grade 
and 24% at eleventh grade. Viewing programs about science on the television 
also becomes less frequent. Two out of three (66.8%) of th^ fourth graders 
view science programs on television during a month. For eighth graders the 
proportion Is 6 out of 10 (60.3%). By eleventh grade less than half (45.2%) 
of the students watch that often. 

Another waty to review the Information about students as consumers of science 
Is to note the proportion of students who avoid science consumer 
experiences. About 3 out of 10 (27%) of the fourth graders reported rarely 
or never readina about science. At eighth grade that proportion Increased 
to 4 out of 10 (40.9%), and at the eleventh grade the ratio was in excess of 
5 out of 10 (55%). Absolute avoidance or rare viewing of science prograips 
on television remains very much the same across grade levels. For each 
level, about a quarter of the students (25% at fourth, 25.4% at eighth and 
26.2% at eleventh grades) avoid science programs. 

Student involvement in doing science declines as students get older. More 
than 4 out of 10 fourth graders (44.7%) talk to parents about science at 
least weekly. About 3 out of 10 (28.4%) eighth graders discuss the subject 
with parents. By the eleventh grade the proportion of students broaching 
the subject is fewer than 2 in 10 (15.3%). There is a corresponding 
increase of students reporting that they rarely or never talk with their 
parents about science, about 4 out of 10 fourth graders, 5 out of 10 eighth 
graders, and more than 6 out of 10 eleventh grader:. 
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The proportion of students who do their own science projects for their own 
purposes declines sharply from fourth to eighth grade. At fourth grade 
better than 4 out of 10 students (42. 9S) Indicate doing projects of their 
own during a month. The proportion drops to less than 2 out of 10 (15S) of 
the students reporting such activity at eighth grade. The decline 
apparently continues through eleventh grade. By that time, fewer than 1 out 
of 10 students (7.5%) do projects on their own. Those students avoldinq 
personal science projects doubles from 4 out of 10 (40.6%) at the fourth 
grade to 8 out of 10 (78.3%) at eleventh grade. Eighth graders report never 
or rarely doing science projects for themselves at a rate of 63.9%. 

Appraisal of Science 

Student appraisal of science was examined through an eleven-Item section on 
the questionnaire. Underlying these questions was an assumption that 
appraisal Is an Important feature of motivation. It was assumed that all of 
the external efforts employed by teachers to promote student Interest In a 
subject are limited In Impact by the values actually held by students for or 
against the discipline being taught. In part, this information answers the 
question, "How receptive are students to science?" 

At all grade levels between three-quarters and four-fifths of the students 
agreed that the contribution of science to their understanding of the world 
around them was Important. At least four-fifths of the students at each 
grade level agreed that knowledge of science would actually contribute to 
that understanding. Student responses to opinion questions also show that 
fourth graders are more positive about the value of science than either 
eighth or eleventh graders. The values declining from grade to grade In 
proportion of approval were: the stu<(y of science would be good for grades, 
science is fun, knowledge of science would earn the approval of teachers, 
knowledge of science would Impress friends, and knowledge of science would 
get them a good job. The least approved of the values of science included 
gaining approval from teachers and impressing friends. Chapter IV uses 
these data as "perceived value of achievement" to predict test results. 

School Professionals and Science 

Part of the environment for science education relates to characteristics of 
the classroom teacher. Students are taught by teachers with different 
backgrounds and with different teaching styles, all of which could influence 
student achievement. 

Teachers and principals In the schools where the Science Assessment was 
administered were asked to respond to questionnaires to provide background 
information about the setting for science Education. Questions included 
demographic characteristics of principals and teachers, questions about 
training related to science, pedagogy, academic standards, and values about 
science. The results presented here, in part, reflect the analysis 
conducted by Dr. Delwyn Harnisch of the University of Illinois. 
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Teachers 



Questionnaires for teachers In schools where the Illinois Inventory of 
Educational Progress was adnlnlstered brought responses from 554 teachers. 
Instructions for the distribution of the questionnaires were for the 
principal to select teachers of science to complete the Information at the 
grade level where testing was taking place. While It Is not suggested that 
the results are randomly representative of all of the teachers at grades 
four» eight or eleven, these data do appear to be Internally consistent 
suggesting that they are an Indicator of actual conditions. 

Virtually all of the schools In the sample are represented by at least one 
teacher. There were 195 replies at fourth, 162 at eighth and 197 at 
eleventh grades. While the entire set of replies Included equal numbers of 
male and female teachers, the proportion at fourth grade was approximately 
four females to every male teacher. At the eighth and eleventh grades, the 
ratio was three males for every female teacher. Analyses of questionnaire 
data show no significant differences between male and female responses. 

Typically, the teachers at all grade levels had more than eleven years of 
teaching experience. Fourth grade teachers typically reported that th^y had 
less than a minor In science preparation. At elohth grade, 5 out of 10 
teachers reported having a major In science, while nearly 9 out of 10 high 
school teachers had a major. The median amount of education also tended to 
Increase as grade levels Increased. Fourth grade teachers typically have t 
BA/BS with 15 hours additional credit or less. Commonly, eighth and 
eleventh grade teachers reported a MA/MS degree. 

Principals 

Another part of the environment for science education relates to the 
principal of the school. Researchers contend that one of the roles of the 
principal Is the Instructional leader and that the settings where the 
principal exerts that Influence are more productive than where the principal 
is less Involved In the curriculum. Researchers suggest that the climate 
for Instruction In schools differs greatly depending on the background and 
beliefs of the principal. 

Questionnaires for principals, therefore, were also Included as part of the 
Illinois Inventory of Educational Progress. Principals from more than 85% 
of the participating schools returned the questionnaires. The 344 responses 
Included 121 at fourth grade. 111 at eighth grade, and 112 at eleventh grade. 

It was anticipated that th^ background of principals might be related to 
their "leadership" In sc1er^<^e. Principals were asked to report how many 
courses they had taken In science. It was found that approximately 
one->quarter of the principals at the fourth grade. Just less than one-third 
of the eighth grade principals, and Just over one-third of the eleventh 
grade principals had at least a minor In science. The most common amount of 
preparation at all grade levels for between 60 and 70% of the principals was 
less than a minor, but more than one course In science. 
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An Interesting note here Is that at the fourth grade level the typical 
principal and the typical teacher have about the same preparation in 
science. For that level. It could make sense for the principal to act as 
the instructional leader and provide curricular advice. At the eighth and 
eleventh grades, however, the science teacher is more likely to have a 
greater amount of content preparation than the principal. At those levels 
the instructional leader concept will have to refer to a more general role 
in support of science education. 

Training in Science 

Inservice and continuing education were two topics explored through the 
survey questionnaire. Inservice generally refers to workshops and training 
sessions held during the school year. Continuing education refers to the 
formal classes that Include college credit and work toward advanced degrees. 

Inservice dealing with science is not a common experience for fourth grade 
teachers who responded to the survey. Six out of 10 of the teachers at that 
level did not participate in inservica related to science within a year and 
a half prior to completing the questionnaire. That proportion drops to 1 
out of 4 at eighth grade and only 1 out of 5 at eleventh grade. One 
possible explanation for this result is that fourth grade teachers are not 
departmentalized and have a broad range of Interests and needs to be served 
through inservice education. The specialization of teachers at eighth and 
eleventh grades would be likely to narrow inservice options considerably for 
teachers at those levels. 

In addition to this finding, eleventh grade teachers who need science 
inservice the most are the least likely to receive it. At the same time, 
reports from the teachers with advanced degrees indicate that they are more 
comfortable teaching science than their colleagues who have less 
preparation. The Juxtaposition of these two bits of Information would 
suggest that the design and implementation of inservice programs might 
benefit from attention to the length of service, the degree attainment and 
the self-reported comfort of teachers in subject areas where they direct 
student learning. 

Both teachers and principals were asked if they participated in professional 
meetings dealing with science or science education. At the fourth grade 
level, approximately 7 out of 10 of both teachers and principals had done so 
at least once during the previous 18 months. While this pattern suggests 
that there may have been some recent emphasis on science in the elementary 
program, the pattern is different for the eighth and eleventh grade 
settings. For both of those more advanced grade levels, only about 
one-fourth of the principals had participated at least once in such meetings, 
while 7 out of 10 eighth grade teachers and 3 out of 4 eleventh grade 
teachers had done so. The fact that the principals at the higher grade 
levels are less Involved in recent professional meetings dealing with science 
may be an indication of less specific attention to science education at this 
time. 
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Pedagogy 



The questionnaires for both the principals and the teachers contained a list 
of twelve pedagogical techniques that could apply to teaching science. Both 
groups were asked to rate the utility of the techniques from very useful to 
not very useful (see Table 3.6). It Is anticipated that the supportive role 
of the principals as Instructional leaders Is likely to be more effective in 
settings where agreement occurs between principals and teachers about 
teaching practices. 

"Hands-on activities by students" was the most favored pedagogical technique 
at all grade levels for both teacners and principals. The belief that 
hands-on activities are Important can be placed In perspective of the 
reported time spent on hands-on and/or laboratory experiences at each of the 
grade levels. Fourth graders typically are exposed to science 105 times 
during the year for 30 minutes at a time. One-fifth of the total time was 
estimated by teachers to be hands-on experience. At eighth grade just over 
one- third of the 176 class periods of 44 minutes In duration were reported to 
be hands-on or laboratory experience. Curiously, only one-fourth of the 
eleventh grade science class time Is reported to be hands-on or laboratory 
experiences. At that grade level, classes average 50 minutes and the 
programs typically are 180 di^s In length. This means that eleventh graders 
actually have slightly less hands-on or laboratory time than the eighth 
graders. While eleventh graders have approximately 41 hours of that type of 
activity in a year, eighth graders have it 44 hours a year. 

Considerable agreement among teachers and principals exists in support of 
"student discussion" as a pedagogical technique. It shows up as second or 
third favored by teachers and third or fourth in rank using the average 
preferences of principals. Disagreement about the utility of "student 
discussion" exists among eighth grade teachers. At that grade level "student 
discussion" is not viewed as favorably by teachers with more advanced degrees 
as their colleagues teaching at the same level. 

Teachers do not agree on a third pedagogy from grade level to grade level. 
Fourth grade teachers Include "student Independent projects," eighth grade 
teachers Include "demonstration by teachers," and eleventh grade teachers add 
"lectures or teacher presentation." These differences are likely to reflect 
what is considered appropriate for students of different age groups. 

Principals Include "demonstration by teachers" in second place among their 
preferences for each grade level. This matches teacher preferences only at 
the eighth grade. 

While some agreements exist about the most preferred techniques, there Is 
somewhat less consensus about those techniques viewed to be of lesser 
utility* (It should be noted that none of the pedagogical tactics received 
an average rating below the mid-point of the scale used in the rating.) 
Memory work does show up as one of the least preferred techniques for all 
lists. Contests or science fairs are of lesser utility in the opinion of 
teachers and high school principals. Guest speakers show up among the lowest 
average ratings for eighth and eleventh grade teachers and principals. 
Finally, worksheets show up among the lower average utility ratings of fourth 
grade teachers und principals for fourth and eighth grade settings. 
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IS! Sl"^ characterl7ed as didactic and heuristic also served as 

Che basis for a question for teachers and principals. This area appears to 
disclose a difference between teachers and principals. Didactic Instruction 
was defined as Involving teacher-led settings where there Is a high degree of 
daily teacher direction in the activities. A heuristic setting was defined 
as involving the teacher and class in processes such as experiment 

Jlf^SJ^tlTiU?! '"'°D^f"' * "^^^^ ^Or-ee of teacher direction in 

the activities. Principals at all grade levels ^snded to respond to the 
heuristic approach more favorably than the teachers. Among the principals, 
those supervising fourth grade settings were decidedly more favorable to 
heuristics. For the teacher groups the most favorable toward didactic 
techniques were fourth and eleventh grade teachers, ticjhth grade teachers 
also tended to favor didactics, but were a bit less emphatic about it than 
their colleagues at other grade levels. 

These jel f-reported characterizations are consistent with other information 
from che questionnaires. Hands-on activities would be expected to be favored 
by heuristically oriented teachers and correlations show this to be the case 
for teachers at all grade levels. 

Standards 



One of the criticisms leveled at schools is that the decline in achievement 
has taken place because of a decline in standards. Questions were Included 
to examine the nature of standards as applied to science. Six questions 
asked what it should take to get an A, A-, or B+ in science. The questions 
^'kJ^; ! attendance, extra time, homework, knowledge, assignments, and the 
^ *° 9^Jeyo"? what is given in cl«ss. (The results are summarized in 
Table 3.7.) There is considerable agreement in the most pre.'arred standards 
from grade level to grade level and between teachers and principals, with one 
notable exception. Principals believed students should be able to go beyond 
what is given in class while that idea was among the least preferred by 
teachers at all grade levels. ^ 

The standards most preferred by teachers at all grade levels Included "doing 
all of thp /-ctivities or assignments," "knowing all of the material," and 
attending every day." The principals from all grade levels agreed with 
attendance and assignments as standards. 

The teachers and principals were somewhat less favorable toward the necessity 
for students to put in a lot of ex^ra time and to do homework every night. 
It should be noted again that while these items were lower in average rating 
than the other items on the list, they were generally stiil viewed as being 
positive standards. There are exceptions, however. A majority of the fourth 
grade principals did disagree with the necessity of nightly homework 9S a 
component of a high irade. A majot ity of teachers at the fourth grade also 
di ' not support the "homework every night" idea. In addition, a mi».jority of 
foy\ h and eighth grade teac.iers also disagreed with the need to put in a lou 
extra time. The extra time standard was highly lavored by eleventh grade 
teachers with advanced degrees. 
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Appraisal of Science 



Teachers and principals were presented with a list of five possible values 
for science education. All of the values were perceived positively by these 
professionals, however^ a few were wore highly prized th:;n the others. Some 
agreement exists for teachers and for principals about some of the values. 
Hov'^ver, between the two groups of professionals, there Is less agreement 
here than for c^' er matters described In this report (refer to T» ile 3.8). 

Among the teacher groups there was agreement that the knowledge of science Is 
Important for students In their everyday lives. Among the principals 
agreement existed for the statement that "science Is a good career for 
students of this generation." 

OtI*. posltlvel;* perceived values for science among the teachers Included 
fourth grade teachers acknowledging science as u cood career^ eighth grade 
teachers viewing science as useful In problem solving for students In school, 
and eleventh grade teachers viewing problem solving for students In life as 
being positive. Fourth and eleventh grade teachers with higher degrees are 
most favorable about this value. Eleventh grade teachers with two to four 
years of teaching experience were noticeably less positive about this value. 

Principals at the fourth grade level were favorable about the potential of 
science as a problem*-solv1ng tool for students In school. Eighth grade 
principals bel level In the Importance of knowledge of science for students 
In everydaty life, and at the eleventh grade level principals viewed 
scientific knowledge as Important for students In future schooling. 

Conclusion 

A recent meta-analysis review of the effects of the Innovative science 
curricula of the 1960"s by Slr^yroansky, Kyle, and Alport ("Research Synthesis," 
pp. 63-66 In Educational Leadership , v.40, n.l, October 1982) concluded that 
science taught In a manner that emphasized scientific processes had a number 
of significant advantages over the "traditional" approaches to science 
education at all grade levels. Tnese Included Imp'^oved achievement. Improved 
student analytic skills. Improved process skills, and Improved attitude 
toward science. 

The magnitude of the performance differences were all greater than 10 
percentile points In all of these areas. The authors also report "...we 
observed this same Increase In achievement scores consistently in elementary. 
Junior high, and high school. Achievement scores were most generally 
enhanced for female students (21 percentile points), urban students (29 
percentile points), and low and high socio-economic status students (35 
percentile points)." (p. 64). 

I* Is 5t this type of approach to science that was Incorporated In the 
Illinois Inventory of Educational Progress. The emphasis on scientific 
process; application of scientific concepts, ideas, and skills; and the use 
of higher order thinking skills were designed to be major components of the 
Science Assessment. 
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The questionnaire data from principals and teachers somewhat surprisingly 
show that there Is greater emphasis on process-oriented science than had been 
thought by contemporary critics of science education such as Fletcher Watson 
(pp. 79-83 In Science Teaching; A Profession Speaks . National Science 
Teachers Association, 198Z). me reader mity be skeptical about self-reported 
data, such as Is used here, and contend that questions oriented toward 
process approaches maty appear to be more socially desirable than Items 
tending toward other pedagogies. The questionnaires, however, do show strong 
Internal consistency, an Indicator that the responses are accurate. The 
results In student achievement showing good performances on process- type and 
higher order thinking skills Items also appear to corroborate the claim. 
Students In Illinois do well on some types of process Items and on some Items 
dealing with higher order thinking skills applied to science. 

Just how optimistic should one be when reading the description of results for 
the Science Assessment In Illinois? Although direct comparison of these 
results to national results cannot be made. In several cases Inferences are 
possible. This section will characterize the science results from the 
National Assessment of Educational Progress and the American College Test. 
In addition, the International Educational Assessment of science Is also used 
to provide a view of the broad context of student performance. 

The first International Educational Assessment of science took place In the 
m1d-60's with the second assessment taking place In 1983-84. Th^ most recent 
results are not yet available. The first a<ta1n1 strati on showed that the top 
science students (the upper 5%) In the United States did as well as students 
In 19 other countries. For students In general ^ however, the United States 
results were among the poorest on the test. 

There Is apprehension among science educators that the latest results will 
repeat the poor showing of the entire sample of students from the United 
States on the earlier assessment. In addition, there Is an anticipation of 
the possibility of poorer results for the top students when considering the 
general decline In student achievement In the United States during the 1970' s. 

Since the results from the United States component of the International 
Assessment are not broken down Into state-levei results, no Illinois-specific 
data are available. However, the performance of Illinois students on other 
Instruments, such as those discussed below, shows average or slightly better 
than average performance. The possible Inference, then. Is that students In 
Illinois would also not perform as well as students from many other nations. 

One point of comp«*r1son used In Illinois Inventory of Educational Progress 
assessments In the past has been the National Assessment of Educational 
Progress— a test of similar difficulty. We can assume this similarity since 
a number of the Items used on the HEP were Items from earlier versions of 
NAEP. 

The last National Assessment took place In 1981. At that time the reports of 
educational decline still had no contrary findings. Indeed, Pakow, Welch, 
and Hueftle wrlt ng In Science Educati on (v. 65, n. 5, 1984, p. 578) about 
the National Assessment conclude tnat tFe decline still was In 
evidence— though the extent of the decline had moderated. They say "...while 
there are a few positive results among the younger age groups (e.g., 

9-year-old gains, leveling of j 3-year-old scores. Increased enrollments In 
science), the overall results are disappointing to most educatoi.." 
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The Illinois Inventory of Educational Progress results bracket the time of 
the National Assessment. Illinois testing; took place In 1981, just prior to 
the National Assessment, and In 1984 after the last National Assessment. A 
general review of those results suggests that Illinois students are doing as 
well. If not better, than their counterparts nationwide, where the national 
results show that performance In higher order thinking skills fall below the 
average for the test. The similar presentation of results for the HEP has 
positive results. 

The college entrance examination commonly known as the ACT has a subtest of 
Interest, the Natural Science Reading Test. The national averages for that 
portion of the ACT rive been essentially stable since 1971. The results show 
the Natural Science results higher than the national average with males 
performing slightly better than females. 

The ACT results for Illinois show a similar pattern. Illinois students 
perform at about the national average on the Natural Science Reading Test. 
Those results fall above the composite average for all of the other subtests 
In the ACT battery. In addition, men consistently perform slightly better 
than women on that portion of the ACT. 

The conclusion that appears to be justified Is that Illinois students are 
performing as well. If not better, than they did four years ago and that 
results are as good, and perhaps better, than students nationally. The 
setting for those results also appears to be favorable for science 
education. The value of science Is generally agreed upon, and the 
pedagogical techniques favored represent approaches suggested to be more 
productive than other techniques. These findings provide some optimism In 
meeting the challenge of science results of studies comparing students In 
different countries. While the Illinois students are not likely to equal 
their peers from other nations, they will have a foundation In science that 
will allow them to proceed to the experiences of higher education and, 
perhaps at that point, to become competitive Intellectually with the students 
of the world. 
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Table 3^ 1984 Percentage of Items Correct by 
Grade-Level and Content Areas 



Performance Level 4th 



8th 



nth 



Above 

Average 

Range 



Earth Science 
66.1 



Life Science 
68.8 

Physical Science 
68.8 



Life Science 
78.0 



Average 
Range 



Life Science 
57.4 

TEST TOTAL 
55.4 



TEST TOTAL 
60.8 



Scientific Processes 
72.2 

TEST TOTAL 
69.4 



Scientific Processes 
55.1 



Scientific Processes 
59.3 



Physical Science 
68.9 



Nature of Science 
67.4 



Below Physical Science Earth Science Earth Science 

Average 47.5 51.9 64.9 

Range 

Nature of Science 
50.9 
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Table 3.3 1984 Percentage cf Items Correct by 
Grade-Level and Skill Areas 



Performance Level 4th 8th Uth 



Above 

Average Knowledge A Analysis, Analysis, 

Range Comprehension Synthesis A Synthesis A 

61.4 Evaluation Evaluation 

66.1 80.4 



Average Application Application 

Range 60.9 71.1 

TEST TOTAL TEST TOTAL TEST TOTAL 

55.4 60.8 69.4 

Analysis, Synthesis 
A Evaluation 
53.7 

Applications 
53.1 



Below 

Average Knowledge A Knowledge A 

Range Cotriprehenslon Comprehension 

56.8 61.0 
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Table 3.4 Percentage of Items Correct 1981-1984 

Comparison by Grade-Level and Content Area 



Performance Level 



4th 



8th 



nth 



Improved 



Life Science 
(52.6 - 57.4) 



Life Science 
(64.5 - 68.8) 



Life Science 
(74.6 - 78.0) 



Scientific Processes 
(50.8 - 55.1) 



Earth Science 
(59.5 - 64.9) 



Similar 



Earth Science 
(64. S - 66.1) 

Physical Science 
(46.1 - 47.5) 



Earth Science 
(51.3 - 51.9) 



Physical Science 
(67.1 - 68.9) 



Physical Science Nature of Science 
(67.0 - 68.4) (65.2 - 67.4) 

Scientific Processes 
(56.4 - 59.3) 



Nature of Science 
(49.4 - 50.9) 
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Table 3»5 1981-84 Percentage of Items Correct 

Comparison 1^ Grade-Level and Skill Area 



Performance Level 



4th 



8th 



nth 



Improved 



Analysis, Synthesis i 

Evaluation 

(45.7 - 53.7> 



Analysis, Synthesis I 

Evaluation 

(76.9 - 80. 4) 



Similar 



Knowledge & 

Comprehension 

(58.6-61.4^ 

Application 
(50.6 - S3.1) 



Application 
m,6 - 60.9) 



Coopreheitslon 
(54.1-S6.8) 

AimIvsIs a 
Syathesls 
Evaluation 
(64.3-66.1) 



Knowledge A 
Comprehension 
(58.6 - 60.0) 

Application 
(68.9 - 71.1) 
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Table 3.6 Pedagogy 

At These Grade Levels - 

4th Grade 8th Grade 11 th Gradf 

Teachers Are More Favorable toward. . . 



Hands-on ActivUles 
Student Discussion 
Independent Projects 



Hands-on Activities 
Demonstration 
Independent Projects 
Student Discussion 



Hands-on Activities 
Student Discussion 
DeiDonstratI on 



Hands-on Activities 
DeiDonstratI on 
Independent Projects 
Student Discussion 



Hands-on Activities 

Lecture 

Discussion 



Contests/Science Fairs 
Memory Work 
Guest Speakers 



Hands-on Activities 
Demonstration 
Questions and Answers 
Student Discussion 



Memory Work 
Guest Speakers 
Contests/Science Fairs 



Principals Are Less Favorable about. . . 

worksheets Memory Work 

Memory Work Worksheets 
Lecture Guest Speakers 



Teachers Are Less Favorable about. . . 

Memory Work Memory Work 

Contests/Science Fairs Guest Speakers 

Work Sheets Contests/Science Fairs 

Principals Are More Favorable toward . . . 
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At These Grade Levels - 
4th Grade 



Table 3.7 Standards 



8th Grade 



11th Grade 



Teachers Are More Favorable toward. 



Do All Assignments 
Know All Material 



Do All Assignments 
Know All Material 
Attend Dally 



Teachers Are Less Favorable about. . . 

Put In Extra Time Put In Extra Time 

Do All Homework Do All Homework 

Go Beyond What's Given Go Beyond What's Given 

Principals Are More Favorable toward. . . 

Attend Dally Do All Assignments 

Do All Assignments Attend Dally 

Go Beyond What's Given Go Beyond What's Given 

Principals Are Less Favorable about. . . 



Do All Homework 
Put In Extra Time 
Know All Material 



Put In Extra Time 
Do All Homework 
Know All Material 



Do All Assignments 
Attend Dally 
Know All Material 



Put In Extra Time 

Do All Homework 

Go Beyond What's Given 



Attend Dally 

Do All Assignments 

Go Beyond What's Given 



Put In Extra Time 
Do All Homework 
Know All Material 
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Table 3.8 Value of Science 



At These Grade Levels - 
4th Grade 



8th Grade 



Teachers Are More Favorable toward. . . 



Careers 

Knowledge for Life 



Knowlege for Life 
Problem Solving in School 



Teachers Are Less Favorable about. . . 

Problem Solving in Life Knowledge for School 

Careers 

Principals Are More Favorable about. . . 

Careers Care**rs 

Problem Solving in School Knowledge for Life 

Principals Are Less Favorable about. . . 

Problem Solving in Life Knowledge for School 
Knowledge for Life Problem Solving in Life 



nth Grade 



Knowledge for Life 
Problem Solving in School 



Careers 

Knowledge for School 



Careers 

Problem Solving in School 



Knowledge for School 
Problem Solving in Life 
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CHAPTER IV 



ANALYSES OF EDUCATIONAL OUTCOMES AND PRODUCTIVITY 

For the last two years the United States Department of Education has 
published a wall chart ranking states In terns of Indicators of student 
achievement and other variables the Department believes to be associated 
with achievement. While the chart reflects national concern for Improving 
education. It also reflects an Inadequate understanding of achievement and 
factors which may Inhibit or facilitate performance. 

Intense national concern for Improving student achievement miur seem to be a 
relatively recent phenomenon, but It has a long history In educational 
research and evaluation. Indeed, some (Dreeben and Thomas, 1980) feel that 
this Is simply the third generation of major Investigations Into educational 
effects. The first generation of studies attempted to link global school 
characteristics to student performance. The most representative stu<fy of 
this type Is the Coleman Report (Coleman, et 1966). In the main, these 
studies used relatively unrefined Indicators of school resources to account 
for differences of performance among students. The second type had as their 
central focus, the Individual student, not the schools. The purpose was to 
determine how far an Individual student would progress given certain 
background characteristics. Thus, phrases such as overachlevers and 
underachlevers were found In this literature, and longitudinal studler began 
to plot student growth (Project Talent, National Longitudinal Stu<ty, Project 
Follow Through). 

However, using only one of these approaches (school or student) to study 
educational effects hfs certain drawbacks. First, they were Insensitive to 
stuctying both differences between schools and also within schools. Much of 
the early work only addressed differences which could be seen when coiiq)ar1ng 
school A to school B (the Coleman Report). The students within each school 
were assumed to be homogeneous and no variations among them were evaluated. 
This withfn-school variation has subsequently been shown to be critical In 
understanding the nature of achievement (Walberg, 1980). In that light, the 
whole of the educational process must be assessed from a multi-level 
perspective (Bur stein, 1980, Fyans, 1983). Students are members of 
classrooms and classrooms are members of schools and schools are members of 
school districts, which are. In turn, members of states. Investigations of 
performance must be carried out at each of these levels. 

The previous attempts also failed to comprehensively portray the achievement 
process: financial models for-jsed solely upon fiscal factors to explain 
performance; resource models stressed curriculum and Instructional 
differences; and psychological models stressed student self-concept and 
Interest. This iRyopla allowed only limited explanations of the complex 
process of acnlevemont. 
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The approach taken In this chapter goes beyond the aforementioned 
Mwltatlons. First, It Is multi-level In orientation. Differences In 
performance were studied at the state, school and student levels. Second, 
the results were evaluated In terms of characteristics within schools as 
well as those at the conventional between school level.~lTrfrd. differences 
in student performance were analyzed both In terms of school context 
variables (size, course offerings, geographic locatlonTwiiinunlty type, and 
s.tloeconomic status (SES) of the school and student characteristics 
(achievement motivation. Intrinsic Interest, opportunities taken to learn, 
parental Involvement, gender, ethnicity, etc.). Three research questions 
guided this Inquiry: ^ 

1. Are there real differences In student achievement between schools, 
and. If so. what Is the magnitude of these differences? 

2. Which school-level characteristics account for these differences In 
performance? 

3. What student-level characteristics account for these differences In 
performance? 

An extensive comparison of Illinois students with ♦■'^elr national 
counterparts concludes the chapter. The comparison focuses on longitudinal 
data gathered by the College Board on the Scholastic Aptitude Test (SAT) and 
the American College Test (ACT). 

The HEP findings Indicate that: 

Question 1 ; Are there real differences In student achievement between 
schools, and. If so. what Is the magnitude of those 
differences? 

* Yes. there are significant differences In achievement noted among 
the schools. District clusters of schools exist In relation to 
performance (exemplary, moderate, deficit). 

Question 2 ; Which school -level characteristics account for these 
differences In performance? 

* Student performance, monitored by college entrance tests such as 
the ACT. Is foun(* to be lower In high schools enrolling 214 or 
fewer or 1.280 or more students. Analysis revealed significant 
differences In performance of students of high schools from these 
enrollments when compared to the achievement of students In schools 
enrolling 215-1.279 students. 

* Results on the Illinois Inventory of Educational Progress indicate 
the highest performance of 11th grade students in science, 
mathematics, geometry and reading occurs in high schools containing 
494-1.279 students. This result occurs after controlling for 
school economic status and the courses offered by the school . The 
HEP analysis also found lower performance of students from schools 
with 214 or fewer students when compared to those enrolling 
215-1.279 students. ^ 
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* Results for eleventh graders on the Decade Study Indicated the 
low St mathematics achievement occurs In schools with less than 215 
students. This compares unfavorably to the means of students of 
moderate-size schools. Across all curriculum areas of the Decade 
Study tests, the highest achievement Is observable In schools with 
more than 435 students. 

* Among sevc-al "school" factors such as enrollment, courses offered, 
economic status, location, and community type, school size had the 
single, strongest predictive weight In explaining performance In 
geometry, science, and mathematics at eleventh grade on the 
Illinois Inventory of Educational Progress. 

Question 3 . What student-level characteristics account for these 
differences In performance? 

* Three student factors are most Influential. They are the students' 
expectations anti standards of performance, the nunber of relevant 
courses taken, and parental Influences. The achievement of a 
student Is directly i Inked to how well that student feels he or she 
should perform and the number of relevant courses the student has 
taken. 

* Differences In performance among students of different ethnic 
groups and genders are attributable to the number of courses taken, 
the expectations and standards held by these students and whether 
the stjdents place a high value on achievement. 

* Consistent school climate effects were detected at each grade 
level. However, this "press to achieve" within a school was not 
directly related to school wealth, location, or courses offered. 

* An unfortunate association Is noted for minority students who 
lacked exposure to courses and had subsequent lower performance. 
This matches national data suggesting that schools containing a 
high concentration of minority students lack relevant courses or 
guidance for minority students. 

A Composite Look 

The results of both the school -level and student-level findings on the HEP 
can be reviewed jointly. Overall, at the eleventh-grade level, student 
factors accounted for 33% of student science performance. School factors 
accounted for approximately }7% of science performance. Taken together 
then, about one-half of a student's performance at eleventh grade can be 
explained by the Information provided by these subsets of school and student 
factors. The single strongest student variable Is that of expectations/ 
standards, followed by experience on relevant courses and parental 
Infljence. The single strongest school predictor was that of school size. 
While It accounted for less performance than student expectations/standards. 
It was clearly the predominant school factor at grade eleven. At grade 
four, school factors affected performance more than student variables. 
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Comparative Information 



One of the primary requests received from schools participating In each 
annual asssssssent Is for comparative Information regarding the performance 
of their students and students from other similar schools. The state 
assessment has never released results identifying specific schools. In the 
appendix, the results associated with certain school factors such as size, 
SES, location, and cotrses offered are presented. School personnel can 
compare the performance of the students from their school with schools 
haviig similar characteristics. 



luestion 1; Are There R ea l Differences between Schools in Stude nt 
icmevement. and, if So.Hhat Is the Magnitude of These Differences ? 



The answer to this question is yes. The si'pport for this answer is derived 
from a series of analyses determining the extent of significant school to 
school differences in each of the subject areas of reading, geometry, 
science and mathematics. Table 4.1 indicates the magnitude and range of the 
between- school differences for eleventh, eighth, and fourth grades. 

Table 4.1 reflects the wide discrepancies among the performance of schools. 
The student means indicate that while there arj exemolary performances 
there are still very low scoring schools. The raige of differences from the 
highest to the lowest performance varies by subject area. At each grade 
level, the widest range of performance is found for the area of 
mathematics. The differences in achievement between the highest and lowest 
school performance in that area is 30.9, 23.0, and 20.7 points in eleventh, 
eighth, and fourth grades, respectively. At eleventh grade a difference of 
30.4 points between the highest and lowest school performa-^ce is found for 
geometry. 

The school performance level can be split it: to three distinct groups of 
schools with similar performance in the upper, middle, and lower third of 
achievement demonstrating exemplary, moderate, and deficit performance. 
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Table 4.1 Range of School Differences in Performance 

Grade Four 



Total Number of 
lest x^ems 


Reading 
ifl 


Geometry 

CI 


Science 


Mathematics 


Range of Performance 


9.4 

5.6-14.8 


9.5 
6.00-17.7 


16.7 

7.*8-24.0 


12.7-33.4 


Upper Third 
liiQQie imrc 
Lower Third 


10.13-14.8 
8.58-10.1 
5.6-8.55 


9.71-17.7 
8.4-9.7 
6.00-8.35 


18.00-24.0 

1 C 70 1 7 0 
ID./U-I /.S 

7.8-15.6 


25.53-33.4 
12.7-21.6 




Grade Eight 






Total Number of 
Test Items 


Reading 
22 


Geometry 
39 


Science 

41 


Mathematics 

AC 


statewide nean 
Range of Performance 


13.1 

8.5-16.5 


15.4 

7.5-24.0 


15.7-31.5 


CQmC 

15.0-38.0 


Upper Third 
niQuic imra 
Lower Third 


13.6-16.5 
12.5-13.5 
8.5-12.4 


16.5-24.0 
12.7-16.3 
7.5-12.7 


26.6- 31.5 

15.7- 22.7 


28.1-38.0 

CO. /-£o. 1 

15.0-23.3 




Grade Eleven 








Reading 


Geometry 


Science 


Mathematics 


Total Number of 
Test Items 


19 


45 


46 




Statewide Nean 
Range of Performance 


11.5 

7.6-14.2 


22.3 

8.2-38.6 


31.5 

18.2-39.3 


28.7 

12.{v-43.4 


Upper Third 
Hiddle Third 
Lower Third 


12.0- 14.2 

11.1- 11.9 
7.6-11.0; 


23.3-3«.6 
20.1-23.3 
8.2-20.0 


33.5-39.3 
30.9-33.4 
18.^^-30.6 


30.3'"43.4 
26.6-30.1 
12.5-26.1 



Some previous studies of performance have implied there v««s essential 
homogeneity among schools in terns of outcomes. CI early » this assumption is 
false. One can classify schools Into groufp;* in terms of the magnitude of 
their performance. This diversity among schools In perfcrmance has 
implications for how technical assistance pregrant sliouTd be directly 
tailored to the needs of a school. Fast attempts at tochnlcal assistance 
may have been too global and less sensitive to the particular needs of a 
school . 
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Question 2; Which School Level Characteristics Account for Differences In 
Performance? 



Given the range of these between-school Differences, It Is necessary to 
Identify the factors which may explain these performance differences. The 
following factors were investigated: 

* School Size 

* Course Offered 

* School /Student Socioeconomic Status 

* School Geographical Location 

* Community Type 

Each of these five factors was first investigated in isolatfon, to determine 
its unique independent effect on school performance. Then in the second 
step, each of the school factors was analyzed in relation to the other s. In 
the third step, the school factors were all analyzed at once with all "their 
interacting effects upon achievement. (At fourth grade, due to lade of the 
information, the variables of community type and courses offered were not 
stut'ied. ) This controlled for any performance differences which m^y have 
been associated with the complex relations among these multiple f'ictors 
(such as investigating the effect of courses offered across the range of 
school sizes and connunity types). The school factors investigated are 
defined first and then the results are presented. 

School Size 



School size is defined as the enrollment of students within a particular 
school in the sample. The data from the HEP indicated that schools across 
the state could be classified in fourths (quartiles) in the following 
categories. These groupings were confirmed by an analysis of all schools in 
the state. These groupings are as follows. 



Size 



Grade Four 



Grade Eight 



Grade Eleven 



Size I 
Size II 
Size III 
Size IV 



1-222 students 
223-322 students 
323-449 students 
450+ students 



1-264 students 
265-441 students 
442-628 students 
629-t- students 



1-214 students 
215-493 students 
4S4-1279 students 
1280+ students 



It should be noted that these groupings are on a school, not district, 
size. Furthermore, the specific grade configuration patterns within a 
district were not studied. However, the sampling design incorporated enough 
diversity for grade configuration, dist"ict size, and ilistrict type to make 
the results associated with these school size groupings representative and 
generalizable to schools of these sizes in the State of Illinois. 

These groups essentially match those in the report. Student Achievement In 
Illinois; An Analysis of Student Progress, 1983. 
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Courses Offered 



At the eighth and eleventh grade. Information was obtained regarding the 
number of courses offered In a particular school. This variable Is defined 
operationally as breadth of oppon>r^l1es to learn within the school and Is 
based upon data prepared for the Census of Course Offerings . The schools 
can be classified In the following groups In terms of the total number of 
courses offered: 



Grade Eight Grade Eleven 

Courses I 1-26 1-24 

Courses II 27-107 25-50 

Courses III 108 -i* 51-129 

Courses IV 130 + 



Socioeconomic Stitus 

For the purposes of this cinalysis, school socioeconomic status Is determined 
by the number of free lunches to which the school Is entitled. The nuirt)er 
of free lunches to which a school Is entitled Is based upon the size of a 
family and family Incoro of Its students. The schools entitled to the 
fewest free lunches are considered to have the wealthiest students. This Is 
a voluntary program. Thus, districts may contain eligible students whose 
parents do not want to participate. It Is critical to note that this 
measure of socioeconomic status Is at the school, not student, level. 
Indicators of student socioeconomic status would be variables such as parent 
education and family Income. The Impact of these student-level 
socioeconomic variables has been demonstrated In previous reports to the 
Board ( Student Achievement In Illinois; An Analysis of Student Progress , 
February 1984, pages 95-97; Student Achievement in iiiinols; 1970 and T981 . 
September 1983, page 4; and Student Achievement tn nitnols; An Analysis of 
Student Progress , November 1982, page 62). These previous findings 
illustrate the direct Influence of familial socioeconomic status upon 
student achievement. Schools were classified as to their variation In 
magnitude by quartlles as follows. 

Grade Four Grade Eight Grade Eleven 



SES I 1-17,806 1-15,005 1-17,452 

SES II 17,807-58,558 15,006-39,307 17,453-40,276 

SES III 58,559-71 9,91if 39,308-719,912 40,277-92,928 

SES IV 719,913 + 719,913 + 92,929+ 



Therefore", SES IV schools would be considered to have the lowest 
socioeconomic status. SES I schools have the highest socioeconomic status. 

School Geographical Location 

Illinois covers a large and diverse geographic area. The counties In 
Illinois have been clustered by the State Board of Education into six 
geographic regions for the purpose of delivering educational services. This 
geographic InfOimatlon was used for determining If the same patterns or 
effect on achievement occur In the same manner across the state, that Is, 
were they general Izable? 

ERIC -56- 72 



These regions are: 

Northeast (NE): Cook» DuPage» Grundy » Kane» Kankakee » Kendall, Lake, 

McKenry, Will. 

Northwest (NW): Boone, Bureau, Carroll, DeKalb, Henry, Jo Daviess, 

LaSalle, Lee, Marshall, Mercer, Ogle, Putnam, Rock 
Island, Stevenson, Whiteside, Winnebago. 

Central West (CW): Adams, Brown, Cass, Christian, Fulton, Hancock, 

Henderson, Knox, Mason, McOonough, Menard, Morgan, 
Peoria, Pike, Sangamon, Schuyler, Scott, Stark, Tazewell, 
Warren. 

Central East (CE): Champaign, Clark, Coles, Cumberland, DeWItt, Douglas, 

Edgar, Ford, Iroquois, Livingston, Logan, Macon, McLean, 
Moultrie, Piatt, Shelby, Vermilion, Woodford. 

Southwest (SW): Bond, Calhoun, Clinton, Greene, Jersey, Macoupin, 

Madison, Monroe, Montgomery, Perry, Randolph, St. Clair, 
Washington. 

Southeast (SE): Alexander, Claty* Crawford, Edwards, Effingham, Fayette, 

Franklin; Gallatin, Hamilton, Hardin, Jackson, Jasper, 
Jefferson, Johnson, Lawrence, Marlon, Massac, Pope, 
Pulaski, Richland, Saline, Union, Wabash, W^ne, White, 
Williamson. 

Community Type 

The United States Bureau of the Census uses standard terms for defining 
communis types. These are central city, suburbs. Independent city, and 
rural areas. These terms are employed In this report for eighth grade 
scudents In Junior high schools and for eleventh grade schools. 

Initially, a district was designated as being urban or rural. A district Is 
considered urban If oiie-half or more of its population llvos in an 
incorporated city of 2,500 more Inhabitants. School districts not 
classified as urban were considered rural . The urban areas are then further 
subdivided. The Census Bureau designates certain large metropolitan areas 
(usually cities with 50,000 or more inhabitants) as central cities . 
Counties with one or more central cities that possess a high degree of 
economic and social integration ire designated as s^^^ndard metropolitan 
statistical areas (SMSAs). Districts located in centrel cities of SMSAs are 
designated as having a central city community type. Districts located in an 
SMSA but not in a central city are designated as having the suburb community 
type, ^r\y district located in an urbanized area but not in an SMSA was 
assigned the Independent city community type. 
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School Size and Student Achievement 



Student achievement levels are widely regarded as reflective of the quality 
of educational progrant. As noted In the 1982 school district organization 
stucly, research on the relationship between school size and student 
achievement has In the past been generally Inconclusive and could not be 
used to make Inferences abo(*t desirable school size. However, over the past 
three years, the State Board's student assessment activities — namely, the 
Illinois Inventory of Educational Progress and the Decade Test— and staff 
research of ACT data for Illinois students have provided Important new 
findings regarding th? relationship of school size and student achievement. 

The Illinois Inventory of Educational Progress 

Students were tested on the HEP In science, geometry* Oiathematlcs and 
reading. The HEP staff analyzed differences In achievement by school size 
by the sizes above, having controlled for effects due to school economic 
status and the number of courses offered. The mean achievement levels of 
eleventh grade students by size of school In science, mathematics, geometry, 
and reading are given In Table 4.2 having controlled for school economic 
status and course offering. Tills analysis Indicated significant differences 
between schools with 214 students or less (Size I) and 1,280 or more (Size 
IV) from the schools containing 215-1,279 students. The lowest achievement 
Is found In mathematics, geometry, and reading In schools wlUi less than 215 
students. In all curriculum areas, the highest achievement Is found In 
schools with 494 to 1,279 students. These school size results occurred when 
controlling for school economic status and courses offered. 

Table 4.2 Mean Scores on HEP Subtests by School Size 
Having Controlled for Effects of School 
Economic Status and Courses Offered 

Grade Eleven 



Science Subtest 



Mathematics Subtest 



Size I (1-214 students) 30.84 

Size II (215-493 students) 31.19 

Size III (494-1279 students) 33.42 

Size IV (1280-t- students) 30.57 



Size I (1-214 students) 24.86 

Size II (215-493 students) 27.21 

Size III (494-1279 students) 32.11 

Size IV (1280-t- students) 30.82 



Geometry Subtest 

Size I (1-214 students) 20.26 

Size II (215-493 students) 21.32 

Size III (494-1279 students) 24.52 

Size IV (1280-t- students) 22.98 



Reading Subtest 

Size I (1-214 students) 10.70 

Size II (215-493 students) 11.34 

Size III (494-1279 students) 12.14 

Size IV (1280+ students) 11.97 



The results for fourth and eighth grades are presented In Table 4.3. At 4th 
grade, for the academic areas of mathematics, geometry, reading, ?rd 
science, significantly lower performance Is found In schools with Ab*) or 
more students. At grade 8, the statistical lower performance In geometry, 
mathematics and science was In schools w'^h 441 students and above. 
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Table 4.3 Mean Scored on HEP Subtests by School Size 



Grade Four 

School Size Reading Geometry Science Mathematics 

Total Test Items 18 27 ""31 TO 

I (1-222 students) 9.66 9.94 17.41 24.40 

II (223-322 students) 9.77 9.70 17.34 24.63 

III (323-449 students) 9.64 9.92 17.18 24.36 

IV (450-t- students) 8.66 8.70 14.88 21.90 

Grade Eight 



School Size 


Reading 


Geometry 


Science 


Total Test Items 


22 


39 


41 


I (1-264 students) 


13.49 


16.52 


25.92 


II (265-441 students) 


13.34 


16.13 


25.97 


III (442-628 students) 


13.10 


15.28 


24.72 


IV (629+ students) 


12.43 


13.56 


22.17 



Ma thematics 


27.95 
27.54 
26.35 
23.21 



The American College Test 

Almost two- thirds of high school graduates In Illinois take the American 
College Test (ACT) before going on to college. The Items comprising the ACT 
subtests are difficult, technical and sensitive to differences In curriculum 
of advanced levels of complexity. 

Differences In performance of Illinois students were found on the ACT In 
relation to school size. Table 4.4 contains the means of students taking 
the ACT In the areas of English, mathematics, social science, natural 
science, and the composite score for schools of the size groups. 

The mean achievement displaced In Table 4.4 Indicates that there was 
significantly lower performance In schools containing 214 or fewer* or 1280 
or more students In English, social science and natural science. A higher 
level of achievement In each curriculum area was noted for schools 
containing 494-1279 students. In no currlcular area did f'hooU with 214 or 
fewer students score as well as scTiools with 215-1279 stu ts. 

A statistical test was then conducted upon these ACT data to test the 
significance of scores of students from schools Kflth 214 or fewer students 
(Size I) and 1280 or more students (Size IV) vis-a-vis those schools with 
215 to 1279 studen - (Sizes II A III). This analysis also adjusted for the 
proportion of students within a school taking the ACT. 
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The findings present highly significant differences In this regard. Hr 
each subtest, and for the composite, these covarlance differences between 
schools of Size I A IV versus II A 111 were significant on the order of 
.0001 or less. Furthermore, these school size differences accounted for 
22%, 20%, 18%, 17% and 17% of the pe^'formance for English, the conposfte, 
natural science, mathematics, and social studies subtests, respectively. 
These findings would argue for an Inverted "U* shape quadratic function 
relating school size to achievement Indicating highest performance of 
moderate size schools. 



Table 4.4 Analysis of Student Achievement on ACT by School Size 

English Subtest Means 



Size I (1-214 students) 17.82 

Size II (215-493 students) 18.18 

Size III (494-1279 students) 18.23 

Size IV (1280+ students) 17.50 



Mathematics Subtest Means 



Size I (1-214 students) 16.18 

Size II (215-493 students) 17.10 

Size III (494-1279 students) 17.70 

Size IV (1280+ students) 17.30 



Social Science Subtest Means 



Size I (1-214 students) 16.46 

Size II (215-493 students) 17.27 

Size III (494-1279 students) 17.51 

Size IV (12?0+ students) 16.91 



Natural Science Subtest Means 



Size 7 (1>214 students) 20.47 

Size II (215-493 students) 21.21 

Sl7e III (494-1279 students) 21.26 

Size IV (1280+ students) 20.48 



The Decade Study Test 



The Decade Study Test contained two subtests monitoring performanr? In 
mathematics (Math I and Math II), two subtests In English (English I and 
English II), a subtest In natural science, and one In social studies. The 
Items comprising the Decade Study subtests are similar In difficulty to 
Items found on tests such as the Scholastic Aptitude Test (SAT). Indeed, 
the Decade Items were developed by the Educational Testing Service In the 
late 1960's for college-entrance examinations. 
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The high schools participating In 1981 were the same schools of 1970 In 
order to match the results of testing programs <tt the schools In 1970 
actalnlstered by the University of Illinois. The profile of those schools 
tended to be smaller, more ruraU and did not Include any Inner city schools 
as would a state representative sample of schools. However, the Decade 
Stucly student results were found to be general Izable to the state by 
statistical equating to the IIEP. 

Previous analysis of the Decade Stu4y data revealed significantly lower 
performance on both mathematlcf subtests, both English subtests, natural 
science and social science subtests for high schools containing 435 or fewer 
students. 

Reanalysis was conducted upon these data In terms of the four school size 
groupings defined above and In terms of the responses of students to the 
number of courses In mathematics they state they took In school. 

The reanalysis revealed that schools containing more than 214 students had 
students taking more than 2.5 courses In mathematics. Indeed, none of the 
schools with 215 or more students had students taking less than 2.60 courses 
In mathematics. 

Per^ov-r^nce ••^ jits for the Mathematics II subtest Indicate near significant 
differences ' -06) for school size groupings. Students of the smallest 
high schools ot^t Ined a mean of 7.82. This compares unfavorably to the 
meand of 8.28 ^0 and 8.20 for the moderate and largest schools (Sizes II, 
III, IV respev -ly). 

An Interaction ^n/^ysls revealed the lowest achievement (an average of 7.67) 
by stJdeiits fro:<; vHe smallest high school > ^nd those taking the least 
course; In nathc ^s. Students of seconJary schools contal.ilng more than 
214 St ide:.ts ac^ higher than their ^?er h the smalle'" schools, even 
when t^t studen .s of the smallest schools re;, t they took ne same number 
of courses In mathematics. 



Results by Courses Offered 

The relationship between courses In a school md tbe achievement of the 
students can be studied from two district pcrsooct-^ves. The first 
perspective Is that of "courses-offered" by - .^^^1. Logic would argue 
that a certain number of courses In a schooi '^.^ :sary for achievement. 
This Is backed up with empirical findings at the ^htn grade with higher 
achievement In schools offering 27 or more courses when compared to schools 
offering less than 27 courses In reading^ science, and mathematics. In 
geometry, a corresponding Increase In achievement Is noted as the number of 
courses offered In a school Increased from 1 to 26 to 27--1 07 to 108 or more . 

However, while the courses offered by a school may provide a necessary 
threshold for achievement, they arc ^ot sufficient. The sufficient factor 
Is the courses taken by the students. It Is an Important factor relating to 
student performance. 
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"^^^^^ ^'5 Mean Achievement on Eleventh Grade IIEP Subtest of 
Science by Semesters of Science Instruction Taken 

IfTnr^l^ ra Hean Science Achievement Mo. of Students Respondlno 

51X or more 36.53 A . 53^^ 

Four or Five 35.16 A 442 

Three 31.63 D 583 

One or Two 28.80 C 034 

None 25.80 D 54 

[Means with same letter are not significantly different.] 

These findings on "courses-tjken" reveal dramatic differences In 
achievement. These findings show that most eleventh grade students take 
lUi SI®/'' ^ semesters of science. They perform significantly higher 
than their peers who have no semesters of science, but perform slqnlflcantlv 
lower than peers taking three or more s£ asters of science. TTierf s aflrost 
an eight point difference between the stu.-nts taking one or twJlemlste?? 
of scle^-e and their peers taking six or more semesters. 

The preceding findings Indicate that the nuiii>er of cour' offered by a 

?f JSlfJ^L:T"rii but "ot sufficient, condition fr chlevement. What 
Is sufficient Is whether the students take the courses, however the 
courses need to exist In a school In order for the students to take them 
Results from the Decade Stu<iy Indicate that while the Ser of coursef 
taken In mathematics highly correlates with student performance, that 
moreover, the number of courses taken correlates with school size. That is. 

J5nHf!!!?"*l °Ii.**'®J'°'"®?* ^^5°°^^ "'•^ ^^^^9 as many courses as other 

students. Further discussion of this effect of exposure to courses taken 

and other student variables such as motivation will be treated in a later 
section of this chapter. 

Results by School Geographic Location 

The achievement results for reading, geometry, science, and mathematics in 
terms of geographic location are presented in Table 4.6. The groupings of 
the state are somewhat gross, howev r, clear and distinct differences among 
the regions can be seen. ' 
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Table 4.6 



Differences In Achievement Related to Geographic Location 



Grade Four 



Geographic 
Location 

Northeast 
Northwest 
Central West 
Central East 
Southwest 
Southeast 



Reading 

8.96 C 
9.98 B 
9.60 BC 
9.91 B 
9.14 C 
10.87 A 



Geometry 

9.51 
10.07 
9.19 
9.44 
9.71 
9.36 



Science 

16.01 C 
17.74 AB 
17.07 ABC 
17.16 AB 
16.86 
18.09 



BC 
A 



Mathematics 

23.44 AB 
24.85 A 
24.09 AB 
23.27 B 
24.12 AB 
24.79 A 



[Means with same letter are equivalent In performance. Schools with 
different Tetters are significantly different. Schools with two letters are 
not considered different from schools with only one of the letters.] 



Geographic 
Location 
Nortneast 
Northwest 
Central West 
Central East 
Southwest 
Southeast 



Geographic 
Location 

Northeast 
Northwest 
Central West 
Central East 
Southwest 
Southeast 



Reading 
13. of 
13.33 
13.27 
13.14 
12.51 
13.59 



Grade Eight 



Geometry 

■nr4:i9AB 

16.36 A 
16.30 A 
16.34 A 
13.94 B 
15.39 A 

Grade Eleven 



Reading 

11.31 B 
11.96 A 
11.77 BA 
11.51 BA 
11.44 BA 
11.26 B 



Geometry 

21.71 B 
25.07 A 
22.83 B 
22.44 B 
21.79 B 
19.39 C 



Science 




Mathematics 




B 


25.55 6 


25.72 


A 


27.33 AB 


25.95 


A 


27.94 A 


25.62 


A 


27.19 AB 


24.31 


B 


25.88 AB 


26.08 


A 


26.47 AB 


Science 




Mathematics 


29.58 


C 


28.23 C 


33.78 


A 


31.53 A 


32.51 


B 


29.48 B 


31.69 


B 


28.36 B 


31.86 


B 


28.78 B 


30.54 


C 


25.80 C 



Results by the Type of Community 

The eleventh grade results are reviewed by community type In Table 4.7. 
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Table 4.7 



Mean Achievement on Tests In Terms of Comnunlty Type 



Grade Eleven 



Community 

Jm 



Reading 



Geometry 



Science 



Mathematics 



Central City 
Suburb 

Independent City 
Rural 



10.24 A 
11.99 A 
11.72 A 
11.61 A 



16.31 CB 
24.39 A 
23.07 AB 
22.70 AB 



24.94 B 
32.53 A 
32.39 A 
32.60 A 



22.04 B 
30.99 A 
29.36 AB 
29.33 AB 



[Means with same letter are equivalent in performance. Schools with 
different letters are significantly different. Schools with two 'etters are 
not considered different from schools with only one of the letters.] 

For geometry and mathematics, the significant difference Is between students 
from suburbs and those from the central cities. 

The scores on the science test show significantly lower score patterns for 
students from the central cities than for those from the rest of the state. 

The Effect of Combined School Factors on Achievement 

A school characteristic can Influence performance not only as an 
Independent, unique effect, but also In combination with other school 
factors. When two Influences work together to affect performance. It Is 
entitled an Interaction effect on performance. The joint effects of school 
size with several other school Influences such as courses offered, economic 
status, and community type were studied. The results Indicated that In some 
cases there were Interacting Influences of certain other school factors -Ith 
school size to affect student achievement. However, none of these 
Interaction effects with school size were as strong as school size taken by 
Itself In Influencing performance. The effects of school size remained 
strong even after statistically controlling for the Interacting effects of 
factors such as courses offered and economic status (see achlvement means In 
Table 4.2). 

The Combined Effect of All Studied School Variables 

The combined Influence of all the five school variables was studied. The 
results of these analyses suggest that knowledge of all these school factors 
Is necessary before attempting to "rank order" schools as has been suggested 
by some educators. 

Other questions may also be answered by these findings. In particular, 
which of these school factors Is most related to school achievement? Is It 
school size, socioeconomic status, location, or community type? Moreover, 
how much of a student's performance can be explained by these school 
factors? Tables 4.8, 4.9, and 4.10 present the results of the analysis In 
terms of the relevance of each school factor to student performance. 
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Table 4.8 Predictive Weight of School Fictors to Student Performance 



Grade Eleven 



School Predictor Reading 

School Size 
Courses Offered 
Conmunlty Type 
Geographic Location 
School Socio- 
economic Status 

Percent of Perfor- 
mance Explained 42 



Geometry Science 



Mathematics 



9% 



17% 



10% 



The plus and negative signs Indicate the relative strengths of certain 
school factors for predicting performance. The symbols In Table 4.8 clearly 
indicate that at grade eleven the single strongest predfctor of performance 
outcome Is the size of the school, inese results occur even when 
controlling for all other school variables and their interactions. 

The percentages In Table 4.8 Indicate the percent of performance of a 
student attributable to these school factors. For example, the state mean 
for eleventh grade science Is 31.5 (see Table 4.1). These results Indicate 
that 17% of that mean or 5.36 point-*. Is attributable to these school 
effects. If the student obtained a score of 20 correct, 3.40 of these 
points are explainable and derived from the characteristics of the school. 

For the area of science, school -level factors are potent predictors of 
eleventh grade student performance. However, for reading, less than four 
percent of the variation In student achievement can be explained by the size 
of school, the courses offered, the Vype of community, the geographic 
location of the school, the SES of the school or their various patterns of 
interaction. 

The ACT was also analyzed to determine the percentage of performance which 
could be attributable to school size. This analysis showed that upwards of 
one-fifth of student performance was explained by school size. School size 
accounted for 22%, 20%, 18%, 17%, and 17% of the performance for Eng'lsn, 
natural science, mathematics, and social studies subtests and the composite, 
of the ACT, respectively. These are significant magnitudes of performance 
accounted for by school size 

The results for grade et^'it are ::,resented In Table 4.9. 
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Table 4.9 Predictive i<e1ght of School Factors to Student Performance 

Grade Eight 

School Predictor Reading Geometry Science Mathematics 
School Size 

Courses Offered + 
Comnunlty Type + 
Geographic Location 
School Socio- 
economic Status 

Percent Perfor- 
mance Explained 6% 15% 20% 14% 

Significant differences from the eleventh grade results are found at eighth 
grade. In particular, the results for school factors at grade eight account 
for a larger average portion of student perfomance when compared to 
eleventh grade. 

Second, the effects associated with size of- school are not the strongest for 
each particular subject area. In the area of ipathematlcs, both courses 
offered and school socioeconomic status are highly significant predictors. 
These relationships Indicate an Increase In the number of courses offered 
and Increases In school socioeconomic status are associated with high levels 
of mathematics performance at eighth grade. The results for science 
Indicate that one-fifth of a student's performance Is attributable to school 
characteristics. 

The findings with regard to the Importance of school factors, especially 
school size and school socioeconomic status provide great Interest. The 
results show that at eleventh grade, school size Is more predictive of 
student achievement than school socioeconomic status. However, at eighth 
grade, school socioeconomic status does become an Important predictor. 
These eleventh grade results may at first glance appear counter-Intuitive. 
However, several factors must be noted. First, the Influences under study 
are at the school not student level. Thus, these findings are not negat^'ng 
the effects of family Income and parent education which have been 
demonstrated In previous Board Reports. High school students with betcer 
educated parents and more wealthy backgrounds will perform higher In outcome 
measures, and these particular students within each school will show 
differential levels of achievement attributable to family Income and parent 
education. 

At eighth grade, perhaps ..here the students arrive from far fewer feeder 
schools and where there may be less diffusion of the wealth of tb" school, 
the direct Impart of school socioeconomic status on achievement Is noted. 

Table 4.10 presents the results for fourth grade. 
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Table 4.10 Predictive Weight of School Factors to Student Perforr -nee 



School kredlctor Reading 



Schoo^ Size -t- 
Geogruphic Location 
3choo1 Socio- 
economic Status 

Percent of Perfor- 
mance Explained 8* 8% }}% 8% 

The school -level factors account most for student performance In the area of 
science. (It should be noted that one cannot readily compare the n. jnltudc 
of performance associated with fourth grade to **.■£ other grades since there 
are fewer predictors at the fourth grade.) SrK ^ -,oc1oeconoro1c status 
appears to have re^nively little relationship tAjfej/t in I'eading achievement. 



Grade Four 
Geometry Science Mathematics 
+ + + 



Question 3; Which Student Level Characteristics Account for Differences in 
Student Performarice "? ~ 

Students responded to a 36-1 tern questionnaire ^o obtaia information 
-egarding the effect of student variables on achievement and the 
I'eiationsh^? of "school climate" to performance. The responses to the 36 
items were -^gregated to construct five predictors of achievement. These 
were: 

* Continuing Motivation 

* Exposure and Opportunity to Learn 

* Parental Influence on Achievement 

* Expectation/Standard 
Perceived Value of Achievement 

The drea Investigated was that of scL.xe. However, this analysis was 
conJ?jcled with the primary goal of showing differences between student 
versus school level predictors of performance and secondarily to more fully 
uno'rstand scfence as a domain Itself. 

Continuing Motivation expresses the intensity of studying outside of the 
school environment. How often do you read books about science other .nan 
the ones yon read in school? Hum often do you watch television documentary 
programs ab, iit n?ture medicine, the solar system, or the universe? How 
often do you do science projects other than the ones you do in school? 
These comprise the scale of contrasting motivation and intrinsic Interest. 
The results f"- this variable will be labeled CM in the tables. 

Exposure and Opportunity to Learn measure the frequency or recency of taking 
'Toi.rses In the area of f 'ence. Are you studying science in school this 
year? How mariy semesteri of science have you had in high school? When was 
your last scir^nce class i.i school? In the tables it will be labeled 
Exposure. 
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Parental Influence on Achievement measured direct parental Influence on 
performance in science, how often do you talk to your parents about 
science? Does your mother or father work In some science-related area such 
as medicine, chemistry, or research? This variable will be labeled Parent 
In the tables. 

Evpec tati on/Standard has a solid foundation In psychology (Rotter 1958, and 
Crandall 1970). The focus Is on how well the student feels he or she will 
perform and the standards the student uses to Judge the performance. 

Fishbeiri (1972) and others have shown that a prochjct of expectations and 
standards can be accurately predictive of himian performance. The scale was 
constructed of a product between expectation (Out of the 46 Items In the 
science test, how many do you thinic yo» answered correctly?) and standards 
(Out of the 46 Items In the science te t, how low could you score and still 
be satlsflea with the results?). The » *sults of the variable will be 
labeled EXP/STD on the tables. 

Pe rceived Value of Achievement measured the value each student attached to 
TTve different Incentives for achievement. These five Incentives are to get 
good grades, to understand the world around roe, to Impress n^y friends, to 
have fun learning, and to get approval from my teacher. This will be 
labeled Incentive In the tables. 

Collectively, these five subscales were measured at fourth, eighth, and 
eleventh grades. 

School Climate Effects 

School climate has been defined In various w^ys. Earlier work In this area 
focused on responses from administrative personnel such as principals or 
teachers as to their perceptions of the school environment. However, work 
by Individuals such as Moos and Brockover h4/e $hown thac a more sensitive 
understanding of school climate can be obtained by aggregating the responses 
of the students to questions regarding school climate, such as their 
responses to questions on expectations and standards and perceived 
Importance oi' schooling. 

Thus, the student responses to the above described 36 Item questionnaire can 
be evaluated from two distinct perspectives. At one level, the responses 
can be studied from the standpoint of students a whole from across the 
itete of Illinois and for partl'-jlar subgroups of that whole (e.g., males, 
females, ethnic differences). In that waiy, the responses function as 
student-level factors. 

From a second, different perspective the responses of students can be 
aggregated within each of their schools. This w1t;i1n-5t:hool data can t^ien 
be compared school to school and also compared against findings pooled 
across all the w1 thin-school data. If school to school differences are 
found, this Is defined as a school climate effect. 

On one level . ey can be studied as how the questionnaire responses of 
particular subset of students, e.g., males, fema^f»«, e*c., (or of studencs 
as a w' jlc) relate to student achievement. In thdt way, they are 
student-level variables and these results will be discussed shortly. 
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The school cHmate Influence is Identified by the extent to which school to 
school differences In mean questionnaire respons>es relate to school to 
school d!fferences In mean achievement. 

Our analysis focused upon both of these perspectives for the student 
responses. The Tlnd'ngs In regard to school climate will be presented 
first, and then the findings for the students as a whole. 

To locate any school -climate effects, the student responses to each of the 
five subscales (defined above) were averaged at each school and then related 
to the achievement of that school. These school to school relationships 
were then pooled across all schools of the state to obtain statewide 
averages. School climate differences were detected on a school to school 
basis when comparing the relationship matrix of the questionnaire data for 
each school against the pooled statewide matrix of the data. Table 4.11 
presents the statewide relationship matrix poole'' ross the separate 
matrices from each school. Several findings are associated with this data. 

First, in terms of school climate, there are strong relationships between 
the school performance upon HEP subtests and the school climate variable of 
expec ta t1 ons/s tandards . 

Second, subsequent analyses revealed dramatic school to school differences 
these school -cl Imate correlations. For example, the correlation between 
expectation/standards and geometry performance was .53 In one school, .45 In 
a second, and .17 In a third school. Thus, the differences among schools In 
tenns of their outcomes are at least partially attributable to the students' 
level of stetndards and expectations. 

A final school climate result is noteworthy. The results in Table 4.11 
indicate a high degree of intercorrelation among the subtests of the HEP. 
For example, performance in science correlates .67 with geometry, .68 with 
mathematics, and .56 with reading. These findings tend to show that, on 
average, in terms of school climate, "success breeds success." That is, a 
press to achieve in one area is linked to outcomes in related areas. 
However, it should be noted that in some schools these intercorrelations 
varied by area. This variability in the correlation Indi' -Ues weaknesses in 
the outcomes of particular curriculum areas. 

Table 4.11 presents the pooled relationships found at grade eleven. 
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Table 4.11 Wi thin-School Correlation Matrix 
of Student Achievement Indicators 



Grade Eleven 



Read Geora Scie Math CM Exposure Parent EXP/STD Incentive 

Reading 1.00 .55 .56 .56 .04 .28 .13 .38 .13 

Geometry .55 1.00 .67 .80 .12 .33 .18 .49 .17 

Science .56 . 67 1.00 . 68 .15 . 36 .17 . 52 . 20 

Math .56 .80 . 68 1.00 . 09 . 35 .15 .46 .12 

CM .04 .12 .15 .09 1.00 .18 .36 .20 .38 

Exposure .28 .33 .36 .35 .18 1.00 .21 .33 .25 

Parent . 3 .18 .17 .15 .36 .21 1.00 .19 .30 

EXP/STD .38 .49 .52 .46 .20 .33 .19 1.00 .26 

Incentive .13 .17 .20 -.12 .38 .25 .30 .25 1.00 



Student Variables 



Student Predictors of Achie.ement in Science 

The analysis was conducted across all the students included in this study 
(regardless of which school they attended) on the science subtt.c as well &s 
the five predictors described above (continuing Motivation, 
exposure/opportunity to learning, parental influence, expectation/standards, 
and incentive value). At this point the responses to the questionnaire were 
analyzed on a student tc student basis and not aggregated to obtain school 
means, "^us, these findings are presented from a student-level 
perspective. The analysis was then conducted across all students evaluating 
the effectiveness of these five predictors in accounting for science 
performance. 

For all students, much more of the performance is accounted for in grade 
eight and grade eleven by the student-level than school-level variables. At 
grade 11, approximately one-third of a student's performance in science is 
attributable to these student factors. For a student score of 90 on an 
examination in science, approximatel.*' 30 points of that are explained by 
these student variables. However, at fourth grade, school factors affected 
performance more than student variables. 

Table 4.)2 details the relative weight and predictive value of these student 
variables for achievement across aHI students of the state. It shows the 
relative change in performance associated with chai.jie in the student 
variables ard amount of performance explained by student factors. 
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Table 4,12 The Predfctfve Relevance of Student 
Variables to Science Performance 



Student Variable Grade Four Grade Eight Grade Eleven 

Continuing Motivation ... 

Exposure/Opportunity to Learn + + + 

Parental Influence + + 

Expectations/Standards + ++ ++ 
Perceived Value 

Perceived Performance 
Explained: A% 23% 33% 

In a comparison of predictive weights for each grade, the strongest 
relationship Is with the achievement expectations and standards of these 
students In all cases. The second strongest predictor Is exposure and 
opportunity to learn. Pare/ital Influence was strongest at grade eight. 

Analysis by Student Subgroup; Ethnicity and Gender 

The student*-level variables were then used to explain differences 1r. 
performakice In terms of ethnicity and gender. Past reports to the Board 
have demonstrated differences In performance between male and female 
students and between ethnic groups. In this report the student level 
approach was used to explain the differences In achievement between gender 
and ethnic subgroups In Illinois In science. Subgroups were defined In 
terms of a students' gender (male, female) and ethnicity (Hispanic, black, 
white and oriental). Table 4.13 presents the relative weight of each 
student variable In explaining the performance of that subgroup. The 
analyses for all subgroups Indicated that significant explanations were 
obtained. 

The findings reveal that complex patterns of exposure, parental Influence, 
student expectations. Incentives and motivation operate to account for 
differences In subgroup achievement. The results are Instructive In 
explaining performance differences among gender and ethnic subgroups. For 
example, thf) eleventh gn.de results Indicate that male students rely upon 
both expectations/standards and exposuv'e to courses or stu^y. For female 
eleventh grade students, expectt^tlons/standards do not have similar weight 
as for their male colleagues. For two female subgroups (white and 
hispanic), parental effects have Influence. In terms of other ethnic 
differences, male hispanic students place a negative Incentive value upon 
achievement. 

These results also confirm those found by Lyle Jones (1984, A.P.A.) and Dr. 
Andrlenne Bailey (1985) linking exposure to subject matter to minority group 
performance. Ihe data Indicate that the lower performance of biack students 
Is derived from their lack of exposure and opportunity to learn. In terms 
of exposure, the Bailey Committee (Equity and Excellence Committee of tne 
College Board) found th^t "'black seniors In 1980 were as likely as whites to 
have taken at least three years of mathematics, but they were much If'ss 
likely to have taken algebra, geometry, trigonometry and ca!c«ilus. Thus, 

their years of coursework must have been concentrated in areas like general 
math or business math." 
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The results In Table 4.13 also reveal a developmental pattern of Influences 
as one moves from fourth to eighth to eleventh grades. The fourth grade 
pattern Indicates a bread range of student predictors of performance. The 
eighth grade functions as a transition year toward high school through 
expectatlons/standarus showing up as being quite predictive of performance 
'nith exposure as an emerging feature. By eleventh grade, it Is clear that 
the two factors of exposure and expectations account for student performance. 

Table 4.13 T'« Prediction of Science Achievement 
by Student Subgroup 

Grade 4 

Student Variables 



Cont. 

Motiv Expo Parent Expect Incentive 



Male Hispanlcs ++ - + 

Male Black 

Male m*e * 
Male Oriental - ++ ++ 

Female Hispanlcs — + 
Female Black 

Female White * 
Female Oriental — + + 



Grade 8 



Male Hispanlcs 
Male Black 
Male White 
Male Oriental 
Female Hispanlcs 
Female Black 
Female White 
Female Oriental 



Cont. 
Motiv 



Expo 
+ 

+ 

+ 
+ 



Parent 



Expect 
+ 



Incentive 



J. 
+ 



Grade 11 



Cont. 

Motiv Expo Paret .: Expect Incentive 

Male H1span1:s + ++ _ 

Male Black + * 

Male White * * 

Male Oriental - + ++ 

Female Hispanlcs — + ++ 

Fen.^le Black ++ 

Female White + ++ 

Female Oriental - ♦+ 
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Performance of Illllnols Students on National Indicators; The ACT/SAT 



Illinois high school students In their Junior and senior years 
take the American College Test (ACT) and the Scholastic 
Aptitude Test (SAT) college entrance tests. Their scores are 
reported on a standardized scale to determine their predicted 
capability for college. 

Other comprehensive comparisons can be made from 1976 to 1984. 
If one looks at the composite SAT average for each subgroup for 
1976-1984, one notes a decrease only for the American Indian 
students. The greatest growth was seen for Puerto Rican 
students with a 72 point Increase across the eight years 
tracked. However, there are only a small proportion of Puerto 
Rican students who take the SAT. The achievement of white and 
oriental students was essentially stable. Table 4.14 portrays 
the Scholastic Aptitude Test data for students In Illinois. 

It should be noted that this Is the first time the College 
Board has released these subgroup achievement data. The 1983 
State board Achievement Report dealt with subgroup comparison 
on the ACT. These complementary results on the SAT are useful 
to monitor the performance of certain subgroups of students In 
Illinois. 



Table 4 14 Illinois SAT Performance Profile 





1976 


1977 


1978 


1979 


1980 


1981 


1982 


1983 


1984 


tot;i 




















NUMBER OF STUDENTS 


26,110 


25,901 


23,718 


22,764 


22,119 


21 ,845 


21,818 


21,533 


21,766 


SAT V - MEAN 


464 


459 


463 


462 


459 


459 


462 


462 


463 


SAT M - MEAN 


509 


507 


511 


511 


507 


508 


515 


517 


518 


SAT V+M - MEAN 


973 


966 


974 


973 


966 


967 


977 


979 


981 


SAT V+M - STD DFV 


(205) 


(205) 


(204) 


(205) 


(202) 


(202) 


(2U2) 


(203) 


(203) 


AMERICAN INDIAN 




















NUMBER OF STUDENTS 


17 


36 


38 


b4 


49 


SO 


58 


61 


52 


SAT V - MEAN 


433 


429 


456 


417 


404 


442 


41 C 


419 


395 


SAT M - MEAN 


411 


482 


484 


479 


444 


475 


458 


462 


440 


SAT V+M - MEAN 


844 


910 


940 


895 


848 


316 


868 


880 


835 


SAT V+M - STD DEV 


(191) 


(244) 


(271) 


(224) 


(195) 


(233; 


(192) 


(213) 


{173; 


BLACK 




















NUMBER OF STUDENTS 


1,175 


1,395 


1,354 


1,365 


1,267 


1,318 


1,341 


1,269 


1.379 


SaF V - MEAN 


378 


381 


389 


384 


38/ 


i84 


392 


392 


390 


SAT M - MEAN 


387 


398 


393 


401 


403 


402 


407 


414 


412 


SAT V+M - MEAN 


766 


778 


782 


785 


790 


78*= 


799 


806 


802 


SAT V+M - STD DEV 


(187) 


(187) 


(191) 


(196) 


(192) 


(189) 


(185) 


(189) 


(186) 
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MEXICAN AMERICAN 
NUMBER OF STUDENTS 
SAT V - MEAN 
SAT M - MEAN 
SAT V+M - MEAN 
SAT V+M - STD DEV 

ORIENTAL 

NUMBER OF STUDENTS 
SAT V - MEAN 
SAT M - MEAN 
SAT m - MEAN 
SAT V+M - STD OEV 

PUERTO RICAN 



1 ^1 

121 


138 


124 


150 


148 


160 


193 


167 


167 






AOO 


AO/ 


AOl 


A^C 






4j2 


460 


463 


462 


469 


457 


481 


475 


463 


474 


887 


897 


885 


902 


884 


917 


912 


897 


907 


(217) 


(192) 


(209) 


(202) 


(193) 


(199) 


(194) 


(196) 


(215 



248 


288 


336 


387 


459 


482 


607 


716 


798 


477 


466 


451 


449 


455 


453 


4S6 


462 


471 


557 


548 


562 


561 


557 


554 


569 


569 


566 


1034 


1014 


1012 


1009 


1012 


1008 


1035 


1031 


1037 


(213) 


(221) 


(219) 


(215) 


(227) 


(214) 


(224) 


(219) 


(221 



NUMBER OF STUDENTS 


56 


50 


43 


42 


61 


61 


62 


61 


77 


SAT V - MEAN 


413 


415 


415 


410 


409 


433 


417 


417 


436 


SAT M - MEAN 


437 


434 


441 


442 


447 


481 


452 


481 


486 


SAT V+M - MEAN 


850 


849 


856 


852 


856 


915 


869 


898 


922 


SAT V+M - STD DEV 


(244) 


(173) 


(168) 


(215) 


(221) 


(232) 


(195) 


(212) 


(211 



WHITE 

NUMBER OF STUDENTS 20,491 21,149 20,'85 19,411 18,657 18,530 18,301 17,856 

SAT V - MEAN 472 467 469 469 466 466 469 469 

SAT M - MEAN 520 517 520 520 515 516 523 525 

SAT V+M - MEAN 992 984 990 989 981 982 992 994 

SAT V+M - STD DEV (196) (197) (196) (197) (195) (195) (194) (195) 

OTHER 

NUMBER OF STUDENTS 
SAT V - MEAN 
SAT M - MEAN 
SAT V+H - MEAN 
SAT V+M - STD DEV 

NO RESPONSE 

NUMBER OF STUDENTS 
SAT V - MEAN 
SAT M - MEAN 
SAT V+M - MEAN 
SAT V+M - STD DEV 



247 


294 


327 


317 


291 


249 


263 


279 


279 


457 


445 


459 


460 


445 


440 


452 


439 


449 


497 


490 


507 


499 


487 


486 


503 


495 


497 


954 


935 


966 


959 


932 


926 


955 


935 


946 


(247) 


(223) 


(229) 


(244) 


(232) 


(229) 


(220) 


(224) 


(227 



3,755 


2,551 


1,311 


1,038 


1,187 


995 


993 


1,125 


1,258 


449 


440 


449 


449 


443 


445 


446 


444 


445 


489 


484 


1S3 


485 


484 


484 


493 


491 


487 


938 


923 


933 


934 


928 


929 


939 


935 


932 


(212) 


(211) 


(214) 


(216) 


(209) 


(212) 


(214) 


(210) 


(214 



In Table 4.14, "V" stands for performance on the verbal subtest, "M" for performance on the 
mathematics subtest, and "V S M" for the total composite score. 
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Breland and his associates at the College Board have recently reanalyzed the 
trend lines In the Scholastic Aptitude Testing and ascribed a good deal of 
Its fluctuation to the size of the American family. Breland et al., 1985, 
provide substantial data Indicating, that as families Increased In size 
during the e'-a of the "baby-boom," a subsequent decline In performance was 
noted. Their prediction Is that as family size declines, subsequent 
Increases In achievement on the College Entrance Examination will be noted 
(as is now being seen). Their prediction is based on the theoretical 
foundation of the Zajonc model at the University of Michigan (1978). 

These same patterns were studied here In Illinois with the HEP. The 
following table details the findings. 

Table 4.15 Performance Differences Due to Family Size 

Grade Eleven 



Family Size 


Geometry 


Mathematics 


Science 


Reading 




Only Child 


30.87 A 


37.44 A 


36.53 A 


13.23 


A 


Two Children 


28.02 B 


35.09 B 


35.16 AB 


13.10 


A 


Three Children 


21.76 C 


28.59 C 


31.63 B 


11.47 


B 


Four Children 


18.10 D 


23.94 D 


28.80 C 


10.51 


C 


Five or More 


lb.91 E 


21.46 E 


25.80 C 


9.69 


D 



These are data coming from the student cohort who would respond sim11«rly to 
the SAT their junior year. The findings in the above table do Indeed 
parallel tije findings from the Breland study. There are dramatic 
differences in performance from students of families of different sizes. 
For geometry, students of families of five or more score almost one-half as 
M'ell as :tudents who are only children. If the trend of decreasing family 
size continues across time, there may be Increased SAT scores. 

The American College Test (ACT) was taken by 106,580 Illinois students in 
1984. The typical student in this group had an ACT compos' score of 18.7 
(group mean) and a high school grade point average of 2.8. zsa compare 
favorably to national averages of 18.5 and 2.9i respectively. At f"* time 
of testing, the responding student felt he or she would obtain a first year 
college grade point average of about 2.8. 

Responses of Illinois student^ taking the 1983-84 ACT to certain backgrouid 
survey questions in terms of satisfaction versus dissatisfaction with theJr 
high school are as follows. 
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Table 4.16 Student Attitudes toward Aspects of High School 





oa tisricQ 


U1 550 t1 ST1 cQ 


Uioh ^rhnnl Tnc^v«iir^4nn 


0C» 


1 0» 




AW 
QClb 


009L 




Dob 


CVTb 


Hiah ^rhnnl Toc^inn 
n 1 yii 1 ic5i»iii(| 




1 \» 


n 1 yii oi»iiuu 1 uuiuciiii»c 




9M. 


Hiah School Pollrlpc 


•tI if 


OCh 


High School Library Facilities 


59% 


16% 


High School Laboratories 


50% 


15% 


High School Special Keeds Assistance 


39% 


15% 


High School Gifted Needs Assistance 


57% 


11% 


High School Career Education and 






Planning Prograns 


45% 


22% 



In tenri:^ ut high school extracurricular actlvltids, the s^ojdents were asked 
to indicate the average number of out of class accompli shnients In nine 
areas. The averages for Illinois students urere Athletics (2.9), Work 
Experience (1.9)» Leadership (1.4)» Music (1.4)» Coisminlty Service (1.1), 
Art (0.9) » Writing (0,9) » Speech (0.8) » and Science (0.6). Given the 
current national emphasis on achievement. It Is Interesting to note that 
students are spending their extracurricular time not on science and writing 
accomplishments, but In athletics and work experiences. 

Of the entire Illinois student population taking the ACT, 50,106 wd*' males 
and 56,474 were females. In response to possible college majors, 3:fi of the 
total were "very sure" of their college? major, while 45% w e "fairly 
sure." Approximately 40% aspired to i Bachelor's level degree, while 46% 
wanted to attain at least some graduate school training or a professional 
degree. The most tyolcally planned college major and vocational choices 
were business and commerce. 

In terms of needs for special help and assistance In the upcoming college 
years, Illinois students Indicated they needed special help In the following 
areas: educational and occupational plans (51%), stucty skills (45%), 
mathematics (44%), reading (36%), writing (29%), and personal concerns 
(14%). Approximately 42% of the stu^nts expressed Interest In Independent 
study, 2''% In honors courses, 26% In foreign stucty, and 57% In advanced 
placement. Sixty-six percent of the students expressed expectations of 
working at a job during their first college year, while 78% expected to . 
apply for financial aid. 

The performance results on the ACT are given In Tables 4.17 to 4.21. A 
significant comparison can be noted If one compares the percentages of males 
versus fe^nales In each of the test score Intervals (Quartlles) for each 
subtest. One would expect 25% of each group to be In each of these test 
score Intervals (Quartlles) for each subtest. However, for natural science 
a 16% difference in the number of male versus female s>tudents is noted for 
the highest Interval. Th1rty-f^ 'e percent of the males but only 19% of the 
females are found In the Interval. For mathematics > a ten percent 
male/female difference Is noted In this highest tsst score Interval. 
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Perhaps the most striking results are In the subtest of English. Looking at 
the percentage of students In the highest test score Interval for the 
Engllsn subtest on i able 4.17, one finds 7% of the students. Table 4.18 and 
4.19 Indicate that only 8% of the females and 6% of the males fall In the 
Interval. While none of the ACT subtests have 25% of the students In this 
<nterva1 33 would be expected from statistical theory, these percentages for 
English are surprisingly low. There are dramatically fewer of the best and 
the brightest In English skills. This Illustrates unexpected low 
performance In communication and articulation skills of Illinois 
college-bound students. These findings may reflect uneval lability of 
advanced studies In high school English vis a vis the adv»rced complete 
offerings In mathematics and science. 

Table 4.20 presences the trend lines In achievement for Illinois students on 
the ACT. There has been an essential plateau effect since 1974-1975. 
However, In 1983-1984, the performance levels did reach 21.0 standard points 
In natural science. The ACT scores have not been at that level since 1975. 

Table 4.21 presents the parallel ACT trend data for the national 
population. For 1983-84, Illinois students were at the national average In 
English and natural science and slightly higher than the national average In 
mathematics and social studies. In terms of Illinois versus the nation 
gender comparisons, the largest gender difference Is found for males, with a 
0.50 difference In mathematics. Illinois males performed higher than males 
from other states. 

The ACT has also been used to study patterns In science and mathematics 
giftedness across the State of Illinois. A county by county analysis was 
conducted of the Incidence of students scoring at or above the 97.5 
percentile on the mathematics or natural science subtests of the ACT. The 
results lidlcated that giftedr.ass In these areas Is not uniformly 
distributed across the state. 

Summary 

Student achievement Is related to student and school factors. Taken 
together, student and school variables account for approximately half of the 
variance In student achievements. Among the variables studied here, school 
size Is the most Important school variable and a student's personal 
expectations and standards are the most Influential student variables. 
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Table 4J7 Distributions of ACT Score Frequencies, Percentile Ranks, and 
Percentages for Men and Women Combined 1983-1984 Schoci Year 



SCORE 


TREQ 


PR 


FREQ PR 


FREQ 


PR 


FREQ 


PR 


FREQ 


36 


0 


99 


7AA 


QQ 


0 


93 


0 


99 


0 


35 


0 


99 


A1 Q 


QQ 
77 


0 


99 


257 


99 


4 


34 


0 


99 


OO^ 


QA 

70 


147 


99 


7<j4 


99 


CO 

59 


33 


274 


99 




Qft 

70 


629 


99 


1135 


98 


A Ail 

204 


32 


22 


99 


1 


Q7 

7/ 


1109 


99 


2557 


97 


Cl 7 

517 


31 


268 


99 


QA7 


70 


885 


98 


3702 


Ail 

94 


OC7 

857 


30 


359 


99 


1 00:7 


QA 
7H 


2149 


96 


4095 


90 


1404 


29 


878 


99 


1 QfiQ 


Q^ 

70 


2902 


94 


3420 


87 


A AAA 

2089 


28 


1351 


98 




Qn 

7U 


1898 


92 


2844 


A M 

84 


A^^ A 

2748 


27 


1474 


96 




ft7 
0/ 


2980 


89 


3076 


A^ 

81 


Af A A 

3520 


26 


3250 


S4 




00 


4003 


86 


6048 


77 


41 A A 

41 99 


25 


3338 


91 




7ft 
/O 


5049 


82 


5488 


71 


A A^A 


24 


4370 


87 


9007 


7A 
/H 


4013 


78 


6637 


66 


5251 


23 


8004 


«^2 


4070 


AQ 
07 


5012 


73 


6410 


59 


5627 


22 


8491 


74 


0^09 


AA 
0*» 


4470 


68 


5071 


54 


f"A^ A 

5818 


21 


8447 


66 


070^ 


CO 
97 


3963 


64 


5134 


M A 

49 


AA 

5789 


20 


7433 


58 


AOStA 


90 


A/ 57 


60 


5002 


44 


^aa^ 

5907 


19 


6777 


52 


OOfC 


9c 


5182 


56 


4854 


40 


P MAP 

5905 


18 


5938 


46 


07Q7 

o/o/ 


Aft 


4020 


52 


5963 


35 


5998 


.7 


7303 


40 


O/OD 


AC 


4484 


48 


7165 


#1 A 

29 


5819 


16 


6312 


33 


1 /79 


A9 


2177 


45 


5509 


23 


5629 


15 


4493 


28 


met 


^Q 
07 


4532 


41 


3446 


^ A 

18 


P A AA 

5382 


14 


4947 


24 


OCT 7 
001 / 


00 


4621 


37 


3971 


15 


5051 


13 


4070 


20 


0/0/ 


Oc. 


3881 


33 


3475 


1 A 

12 


4773 


12 


4913 


15 


40D0 




4837 


29 


2966 


8 


J A*l** 

437/ 


11 


^97^ 


12 


090U 




5036 


24 


2292 


6 


o874 


10 


35d7 


9 


9 ft AO 




6255 


19 


1813 


4 


Oil Af) 

o403 


9 


2362 


6 


^A7Q 
00/ 7 


1Q 
1 7 


4110 


14 


1434 


3 


A*71 A 

2712 


8 


1518 


4 


1890 


16 


4526 


10 


1041 




ZOoo 


7 


1070 


3 


2859 


14 


2870 


7 


439 


] 


1 A AC 

1426 


V 


1095 


2 


3725 


11 


2381 


4 


388 




749 


5 


719 


1 


2183 


8 


1344 


3 


103 




319 




405 


1 
1 


1014 


6 


1045 


1 


44 




115 


3 


142 


1 


1768 


5 


555 


1 


13 




28 


2 


47 


1 


983 


4 


277 


1 


3 




5 


1 


9 


1 


3537 


2 


171 


1 


1 




0 




Percentages of S 


tudents in Various Test Score Intervals 


26-36 


7876 


7 


'1273 


20 


16702 


16 


27918 


26 


15601 


21-25 


32650 


31 


23Jul 


22 


23507 


22 


28740 


27 


27444 


16-20 


33763 


32 


17524 


16 


19930 


19 


28493 


27 


29258 


1-15 


32291 


30 


43882 


41 


46441 


44 


21429 


20 


34277 


(MEAN) 


18.1 


17.6 


17.5 


21.0 


18.7 


S.D. 


5.5 




8.5 


7 


.3 




6.4 


6.1 


Total 


Number of Students - 


106,580 













99 
99 
99 
99 
99 
99 
98 
96 
94 
91 
87 
83 
78 
73 
68 
62 
57 
51 
46 
40 
35 
30 
25 
20 
16 
12 
9 
6 
3 
2 
1 
1 
1 
1 
1 
1 



15 
26 
27 
32 
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Tabl^ 4.18 Distributions of ACT Score Frequencies, Percentile Ranks, and 
Percentage! for Women 1983-1984 School Year 

E'»9l1sh Matheinat<-» Social Studies Natural Selene. Composite 
SCORE FREQ PR FREQ PR FREQ PR FREQ PR FREQ PR 



36 


0 


99 


193 


99 


0 


99 


0 


99 


0 


99 


35 


0 


99 


184 


99 


0 


99 


24 


99 


0 


99 


34 


0 


99 


256 


99 


26 


99 


98 


99 


16 


99 


33 


175 


99 


174 


99 


195 


99 


211 


99 


52 


99 


32 


13 


99 


520 


98 


349 


99 


662 


99 


162 


99 


31 


158 


99 


331 


97 


314 


99 


1190 


97 


270 


99 


30 


215 


99 


576 


97 


819 


98 


1539 


95 


506 


99 


29 


530 


99 


747 


95 


1245 


96 


1342 


92 


744 


98 


28 


783 


97 


1398 


93 


844 


94 


1292 


90 


1110 


96 


27 


878 


96 


1672 


91 


1318 


92 


1356 


88 


1446 


94 


26 


1909 


93 


2513 


87 


1868 


89 


2872 


84 


1881 


91 


25 


1923 


90 


1835 


83 


2426 


85 


2735 


79 


2391 


87 


24 


2510 


86 


2691 


79 


1993 


82 


3464 


73 


2573 


83 


23 


4537 


80 


2248 


75 


3064 


77 


3482 


67 


2897 


78 


22 


4819 


72 


3284 


70 


2256 


72 


2829 


62 


3005 


72 


21 


4613 


63 


1998 


65 


2084 


69 


2924 


57 


3079 


67 


20 


4040 


56 


2252 


61 


2185 


65 


2808 


51 


3228 


61 


19 


3672 


49 


2070 


58 


2773 


60 


2930 


46 


3217 


56 


18 


3110 


43 


1974 


54 


2267 


56 


3498 


41 


3277 


50 


17 


3835 


37 


2111 


50 


2536 


52 


4473 


34 


3238 


44 


16 


3223 


30 


915 


48 


1187 


48 


3285 


27 


3126 


39 


15 


2274 


25 


2338 


45 


2516 


45 


2206 


22 


3092 


33 


14 


2442 


21 


2107 


41 


2590 


41 


2538 


18 


2982 


28 


13 


1937 


17 


2157 


37 


2156 


36 


2153 


14 


2752 


23 


12 


2394 




2509 


33 


273C 


32 


1878 


10 


2615 


18 


11 


1405 


10 


2078 


29 


2918 


27 


1438 


7 


2356 


14 


10 


1698 


7 


1721 


26 


3636 


21 


1157 


5 


2100 


10 


9 


1106 


5 


21 80 


22 


2485 


16 


865 


3 


1630 


6 


8 


705 


3 


1186 


19 


2676 


11 


647 


2 


1232 


4 


7 


50G 


2 


1778 


17 


1704 


7 


264 


1 


838 


2 


6 


481 




2374 


13 


1377 


5 


226 


1 


424 




5 


312 




1369 


10 


767 


3 


58 


1 


163 




4 


185 




657 


8 


588 


2 


25 


1 


57 




3 


68 




1132 


6 


339 


1 


4 


1 


12 




2 


18 




627 


5 


145 


1 


1 


1 


3 




1 


6 




2319 


2 


98 


1 


0 


1 


0 





Percentages of Students In Various Test Score Intervals 



26-36 


4661 8 


8564 15 


6978 


12 


10586 


19 


6187 


11 


21-25 


18402 33 


12056 21 


11823 


21 


15«34 


27 


13945 


25 


16-20 


178S0 32 


9322 17 


10948 


19 


16994 


30 


16086 


28 


1-15 


15531 28 


26532 47 


26725 


47 


13460 


24 


20256 


36 


(MEAN) 


18.5 


16.4 




16.7 




19.9 


18.0 




S.D. 


5.4 


8.3 




7.1 




6.0 


5.9 





Total Number of Students - 56,474 
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Table 4.19 Distributions of ACT Score Frequencies, Percentile Ranks, and 
Percentages for Men 1983-1984 School Year 





English 


Mathematics 


Social 


Studies 


Natura 






DD 
PR 


FREQ 


PR 


FREQ 


An 

PR 


FREQ 




0 


AA 

99 


PAP 

595 


99 


A 

0 


A 


0 


00 


0 


99 


435 


98 


0 


A A 

99 


233 




0 


99 


626 


97 


^ A^ 

121 


99 


686 


00 




AA 

99 


^A A 

322 


A^ 

96 


434 


99 


924 




9 


AA 

99 


973 


95 


Tf A 

760 


98 


1895 


01 


1 1 n 
110 


AA 

99 


636 


93 


571 


97 


2512 


ou 


144 


A A 

99 


993 


92 


1330 


95 


2556 


90 


Oil o 

348 


AA 

99 


^ A ^ A 

1242 


90 


1657 


92 


2078 


CO 


boo 


An 

98 


1895 


86 


1 AC ^ 

1054 


AA 

89 


1552 


97 

Ll 


090 


ft"? 
9/ 


Ol il o 

2148 


AA 

82 


1662 


A^ 

87 


1720 




1 O ill 

1341 


AC 

95 


2844 


77 


A 1 AC 

2135 


83 


3176 


cO 


1 il 1 c 

1415 


AA 

92 


2102 


73 


Af A O 

2623 


^ A 

78 


2753 




1860 


89 


2678 


68 


2020 


73 


31 73 


CO 


Oil 

3467 


A M 

84 


2150 


63 


2948 


68 


2928 


oo 

CL 


3672 


76 


2981 


58 


2214 


63 


2242 


91 
c\ 


3834 


f A 

69 


^ AO ^ 

1934 


53 


^ A^A 

1879 


59 


2213 


on 


339o 


62 


2032 


49 


1882 


55 


21 94 


1 o 

17 


31 05 


55 


1802 


45 


2409 


51 


1924 


10 

lo 


2828 


M A 

49 


1813 


42 


1753 


47 


2465 


17 


Oil CO 

o4oo 


il o 

43 


1675 


38 


1948 


43 


2692 


lit 
10 


OA on 

00o9 


0"7 

37 


AAA 

880 


Af 

36 


AAA 

990 


4 A 

40 


2224 


1^ 
10 


001 o 

cc 1 9 


oi 
Ol 


1789 


oo 

33 


O Al C 

2016 


0"1 

37 


1240 




ocnc 


cl 


1 CI A 

1510 


A A 

30 


O AO! 

2031 


A A 

33 


1433 


10 


oi 

^lOO 




1610 


26 


1 "70C 

1725 


OA 

30 


1322 


19 


OCT ft 


17 


1 AC il 

1854 


A A 

23 


Ol A"7 

2107 


Of 

26 


^ AAA 

1088 


11 
1 1 




1 o 

13 


1 il CO 

1452 


A A 

20 


Ol 1 o 

2118 


A A 

22 


854 


in 


1 OOft 

1oZ9 


1 A 

10 


1119 


17 


Of 1 A 

2619 


17 


656 


Q 
7 


1256 


7 


^ 4 A A 

1499 


15 


T f AC 

1625 


^ A 

13 


569 


0 


Q1 7 
O 10 


c 
O 


/04 


\c 


1850 


9 


394 


7 


570 


3 


1081 


11 


1 loo 


0 


1 "1 c 

175 


6 


614 


2 


1351 


8 


1004 


4 


162 


5 


407 


1 


814 


6 


577 


2 


45 


4 


220 


1 


357 


5 


A57 


1 


19 


3 


74 


1 


636 


4 


2i6 


1 


9 


2 


29 


1 


356 


3 


132 


1 


2 


1 


3 


1 


1218 


1 


73 


1 


1 



PR FREQ PR 

99 0 99 

99 4 99 

99 43 99 

97 152 99 

94 355 99 

90 587 98 

85 898 97 

80 1345 95 

77 1638 92 

73 2074 88 

69 2318 84 

63 2568 79 

57 2678 73 

51 2730 68 

46 2813 62 

41 2710 57 

37 2679 52 

33 2688 46 

28 2721 41 

2? 2581 36 

18 2503 30 

15 2290 26 

12 2069 21 

9 2021 17 

7 1762 13 

5 1518 10 

3 1303 7 

2 1082 5 

1 831 3 

1 588 2 

1 325 1 

1 156 1 

1 58 1 

1 16 1 
1 2 

1 0 1 



Percentages of Students In Various Test Score Intervals 

26-36 3215 6 12709 25 

21-25 14248 28 11845 24 

16-20 15C83 32 8202 16 

1-15 16760 33 17350 35 

(MEAN) 17.7 19.1 
S.D. 5.5 8.4 

Total Number of Students* - 50,106 
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9724 


19 


17332 


35 


9414 


19 


11684 


23 


13306 


27 


13499 


27 


8982 


18 


11499 


23 


13172 


26 


19716 


39 


7969 


16 


14021 


28 




18.3 


22.3 




19.5 






7.5 


6.6 




6.2 
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T able 4.20 ACT Score Means 4 Standard Deviations for Successive Years 

of ACT-Tested College-Bound Students 
Illinois 



English Math Soc. Studies Natural Sci. Composite 

MEAN (SD) MEAN (SD) MEAN (SD) MEAN (SD) MEAN (SD) 



SCHOOL 
YEAR 



WOMEN COMblNEUT 
— 2TTD ^ 



TOTAT 



1966- 67 

1967- 68 

1968- 69 
1965-70 

1970- 71 

1971- 72 

1972- 73 

1973- 74 

1974- 75 

1975- 76 

1976- 77 

1977- 78 

1978- 79 

1979- 80 

1980- 81 

1981- 82 

1982- 83 

1983- 84 



20.0 
19.8 
19.8 
19.2 
18.7 
18.4 
18.5 
18.1 
18.1 
17.4 
17.7 
17.8 
17.7 
17.8 
17.8 
17.9 
17.9 
18.1 



5.0 
5.0 
5.2 
5.6 
5.5 
5.5 
5.3 
5.4 
5.5 
5.4 
5.6 
5.5 
5.5 
5.5 
5.5 
5.7 
5.5 



IHE N AND 
20.5 - 
20.4 
21.2 
21.1 
LJ.3 
20.1 
20.2 
19.1 
18.1 
17.7 
17.7 
17.5 
17.5 
17.6 
17.6 
17.6 
17.3 
17.6 



7. 
6. 
6. 
7. 
7. 
7. 
7. 
8. 
7. 
8. 
7. 
7. 
7. 
8. 
8. 
8. 
8. 



21.0 
20.6 
20.5 
19.4 
19.2 
19.0 
,8.4 
17.8 
17.0 
17.6 
17.0 
17.1 
17.3 
17.3 
17.5 
17 2 
17.5 



6.3 
6.3 
6.4 
7.0 
7.1 
7.6 
7.7 
7.6 
7.3 
7.3 
7.3 
7.2 
7.3 
7.4 
7.4 
7.3 
7.3 



21.3 
21.1 
21.2 
21.5 
21.2 
21.2 
21.3 
21.1 
21.2 
20.6 
20.7 
20.6 
20.9 
20.9 
20.9 
20.7 
20.7 
21.0 



6.3 
6.2 
5.9 
6.2 
6.3 
6.3 
6.3 
6.3 
6.6 
6.5 
6.5 
6.2 
6.2 
6.0 
6.3 
6.5 
6.4 



20. 
20. 
20. 
20. 
20. 
19. 
19. 
19. 
18. 
18. 
18. 
18. 
18. 
18. 
18. 
18. 
18. 
18. 



5.3 
5.2 
5.2 
5.6 
5.6 
5.8 
5.8 
6.0 
6.0 
6.0 
6.0 
5.8 
5.9 
5.9 
6.0 
6.1 
6.1 



1966-67 


19.1 


5.0 


21.6 


1967-68 


18.7 


5.1 


21.5 


1968-69 


18.9 


5.1 


22.1 


1969-70 


18.4 


5.3 


22.2 


1970-71 


17.7 


5.7 


21.4 


1571-72 


17.6 


5.6 


21.2 


1972-73 


17.6 


5.4 


21.4 


1973-74 


17.4 


5.2 


20.5 


1974-7l> 


17.5 


5.3 


19.7 


1975-76 


16.9 


5.5 


19.4 


1976-77 


17.2 


5.3 


19.4 


1977-78 


17.4 


5.6 


19.1 


1978-79 


17.4 


5.5 


19.1 


1979-80 


17.3 


5.5 


19.0 


1980-81 


17.3 


5.4 


19.1 


1981 -82 


^•7.4 


5.4 


19.0 


1982-83 


i7.5 


5.7 


18.7 


1983-84 


17.7 


5.5 


19.1 



MEN 

7.1 

7.3 

6.8 

6.8 

7.4 

7.4 

7.5 

7.; 

8.2 
7.8 
8.0 
7.9 
7.9 
7.9 
8.2 
8.3 
8.5 
8.4 



21.1 


6.2 


22.3 


6.2 


21.2 


5.3 


21.4 


6.3 


22.0 


6.4 


21.0 


5.4 


21.2 


6.3 


22.1 


6.2 


21.2 


5.3 


21.2 


6.4 


22.3 


6.1 


21.1 


5.3 


19.7 


7.1 


21.9 


6.4 


20.3 


5.7 


19.8 


7.1 


22.1 


6.4 


20.3 


5.7 


19.8 


7.6 


22.3 


6.4 


20.5 


5.9 


19.3 


7.6 


22.5 


6.4 


20.1 


5.9 


19.1 


7.6 


22.4 


6.4 


19.8 


6.0 


17.9 


7.4 


21.7 


6.7 


19.1 


6.0 


18.5 


7.4 


22.1 


6.6 


19.4 


6.0 


17.8 


7.5 


21.8 


6.7 


19.1 


6.1 


18.2 


7.3 


22.1 


6.4 


19.3 


5.9 


18.2 


7.4 


Z2.2 


6.3 


19.3 


5.9 


18.3 


7.5 


22.0 


6.2 


19.3 


6.0 


18.4 


7.5 


22.1 


6.4 


19.4 


6.1 


18.1 


7.4 


22.0 


6.6 


19.2 


6.2 


18.3 


7.5 


22.3 


6.6 


19.5 


6.2 



ERIC 



37 
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Table 4.20 (Con't) 

SCHOOL English Math Soc. Studies Natural Sci. Composite 

YEAR MEAN (SD) MEAN (SD) MEAN (SD) MEAN (SD) MEAN (SD) 

wsm 

1966- 67 21.1 4.5 1 9.3 77I~20.8 6.1 20.2 5.8 20.5 5.0 

1967- 68 21.0 4.6 19.3 7.3 20.6 6.2 20.1 6.0 20.4 5.1 

1968- 69 20.7 4 7 20.2 6.6 19.8 6.3 20. "i 5.9 20.4 5.0 

1969- 70 20.1 5.0 20.0 6.6 19.8 6.4 20.7 5.6 20.2 5.0 

1970- 71 19.6 5.3 19.3 7.1 19.2 6.9 20.4 5.9 19.8 5.4 

1971- 72 19.2 5.3 18.9 7.3 18.7 7.1 20.3 6.1 19.4 5.5 

1972- 73 19.2 5.4 19.0 7.3 18.1 7.5 20.4 6.0 19.3 5.7 

1973- 74 18.8 5.2 17.8 7.5 17.6 7.6 19.8 5.8 18.6 5.6 

1974- 75 18.5 5.4 16.7 7.9 16.6 7.4 20.2 6.0 18.1 5.8 

1975- 76 17.9 5.5 16.3 7.5 16.2 7.2 19.7 6.4 17.6 5.8 

1976- 77 18.2 5.4 16.3 7.7 16.7 7.2 19.5 6.2 17.8 5.8 

1977- 78 18.2 5.6 16.2 7.6 16.3 7.1 19.6 6.2 17.7 5.8 

1978- 79 18.0 5.4 16.2 7.5 16.2 7.0 19.9 5.9 17.7 5.6 

1979- 80 18.2 5.5 16.3 7.5 16.6 7.2 19.9 5.9 17.8 5.7 

1980- 81 18.3 5.5 16.3 7.9 16.5 7.2 19.9 5.7 17.9 5.7 

1981- 82 18.3 5.5 16.4 8.2 16.8 7.3 19.6 5.9 17.9 5.9 

1982- 83 18.3 5.6 16.1 8.2 16.4 7.0 19.5 6.1 17.7 5.9 

1983- 84 18.5 5.4 16.4 8.3 16.7 7.1 19.9 6.0 18.0 5.9 



TABLE 4.21 



ACT Score Means & Standard Deviations for Successive Years 
of ACT-Tested College-Bound Students 
National 



SCHOOL 


English 




Math 




Soc. otudles Natural Scl. 


Composite 


YEAR 


MEAN 


(SD) 


MEAN 


(SD) 


MEAN 


(SD) 


MEAN 


(SD) 


MEAN 


(SD) 






TOTAL (MEN AND WOMEN COMBINED) 










1969-70* 


18.5 


5.1 


20.0 


6.6 


19.7 


6.6 


20.8 


5.9 


19.9 


5.1 


1972-73 


18.1 


5.3 


19.1 


7.2 


18.3 


7.4 


20.8 


6.3 


19.2 


5.7 


1973-74 


17.9 


5.2 


18.3 


7.4 


18.1 


7.6 


20.8 


6.4 


18.9 


5.7 


1974-75 


17.7 


5.3 


17.6 


7.9 


17.4 


7.5 


21.1 


6.3 


18.6 


5.8 


1975-76 


17.5 


5.4 


17.5 


7.6 


17.0 


7.3 


20.8 


6.6 


18.3 


5.9 


1976-77 


17.7 


5.2 


17.4 


7.8 


17.3 


7.3 


20.9 


6.5 


18.4 


5.9 


1977-78 


17.9 


5.4 


17.5 


7.7 


17.1 


7.3 


20.9 


6.5 


18.5 


^ 5.9 


1978-79 


17.9 


5.4 


17.5 


7.6 


17.2 


7.2 


21.1 


6.3 


18.6 


5.8 


1979-80 


17.9 


5.4 


17.4 


7.6 


17.2 


7.3 


21.1 


6.2 


18.5 


5.8 


1980-81 


17.8 


5.4 


17.4 


7.9 


17.2 


7.3 


21.0 


6.1 


18.5 


5.8 


1981-82 


17.9 


5.3 


17.2 


8.0 


17.3 


7.3 


20.8 


6.3 


18.4 


5.8 


1982-83 


17.8 


5.5 


16.9 


8.2 


17 1 


7.3 


20.9 


6.5 


18.3 


6.0 


1983-84 


18.1 


5.3 


17.3 


8.0 


17.3 


7.3 


21.0 


6.3 


18.5 


5.9 



*The data were unavailable for 1970-71 and 1971-72. 
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1969-70* 


17.6 


5.2 


21.1 


1972-73 


17.3 


5.3 


20.2 


1973-74 


17.1 


5.2 


19.7 


1974-75 


17.1 


5.2 


19.3 


1975-76 


16.8 


5.4 


19.2 


1976-77 


17.0 


5.2 


18.9 


1977-78 


17.4 


5.4 


19.1 


1978-79 


17.4 


5.4 


19.1 


1979-80 


17.3 


5.4 


18.9 


1980-81 


17.3 




18.9 


1981 -82 


17.3 


5. 


8.6 


1982-B3 


17.3 


5.b 


/8.4 


1983-84 


17.5 


5.4 


18.6 


1969-70* 


19.4 


4.9 


18.8 


1972-73 


18.9 


5.1 


18.0 


1973-74 


18.6 


5.1 


17.1 


1974-75 


18.3 


5.2 


16.2 


1975-76 


18.0 


5.3 


16.0 


1976-77 


18.2 


5.2 


16.1 


1977-73 


18.3 


5.4 


16.2 


1978-79 


18.4 


5.3 


16.2 


1979-80 


18.3 


5.4 


16.2 


1980-81 


18.2 


5.4 


16.0 


1981-ft2 


18.4 


5.3 


16.0 


1982- 


18.2 


5.4 


15.7 


198? 


18.6 


5.2 


16.1 



MEN 
5X 
7.2 
7.4 
^9 
7.7 
7.8 
7.7 
7.6 
7.7 
7.9 
8.0 
8.2 
8.0 



20.3 
19.0 
19.1 
18.7 
17.9 
18.2 
18.0 
18.1 
18.2 
18,3 
18.1 
18.0 
18.1 



,6 
5 
6 
5 
4 
4 
4 
4 
4 
5 
5 
5 
5 



21.6 
21.7 
22.2 
22.4 
22.0 
22.3 
22.3 
22.3 
22.4 
22.3 
22.2 
22.4 
22.4 



6.1 
6.5 
6.5 
6.4 
6.7 
6.6 
6.6 
6.5 
6.3 
6.3 
6.4 
6.6 
6.5 



20.3 
19.7 
19.7 
19.5 
19.1 
19.2 
19.3 
19.3 
19.3 
19.3 
19.2 
19.1 
19.3 



6.4 
7.0 
7.2 
7.6 
7.3 
7.5 
7.4 
7.2 
7.3 
7.6 
7.7 
7.9 
7.8 



5.2 
5.8 
5.8 
5.9 
5.9 
6.0 
6.0 
5.9 
5.9 
5.9 
6.0 
6.1 
6.1 



19.0 
17.7 
17.3 
16.4 
16.2 
16.5 
16.4 
16.4 
16.4 
16.4 
16.6 
16.4 
16.5 



6.5 
7.4 
7.5 
7.3 
7.1 
7.1 
7.0 
7.0 
7.1 
7.1 
7.1 
7.1 
7.1 



20.0 
19.9 
19.6 
20.0 
19.7 
19.6 
19.8 
20.2 
20.0 
20.0 
19.7 
19.6 
19.9 



5.7 
6.0 
5.9 
6.0 
6.3 
6.2 
6.2 
5.9 
5.9 
5.8 
5.9 
6.2 
5.9 



19.4 
18.8 
18.2 
17.8 
17.6 
17.8 
17.8 
17.9 
17.9 
17.8 
17.8 
17.6 
17.9 



5.0 
5.5 
5.5 
5.6 
5.7 
5.7 
5.7 
5.5 
5.6 
5.7 
5.7 
5.8 
5.7 



*The data were unavailable for 1970-71 and 1971-72. 
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APPENDIX A.I 
Grade Four 

Mean Achievement Scores by School Characteristics 



Size of 
School 



2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
2 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 



ERIC 



Geog. 
Regl on 

1 
1 
2 
2 
2 
2 
3 
3 
3 
4 
4 
5 
5 
6 
1 
1 
1 
2 
2 
2 



5 
6 
1 
1 
1 
1 
2 
2 
3 
3 
4 
5 
1 
1 
1 
2 
2 
2 
2 
3 

4 

6 
6 



Soclo- 

Economic 

Status 

^1 

2 

3 
4 
1 
2 
4 
1 
2 
3 
2 
3 
1 
3 
1 
1 
3 
4 
1 
3 
4 
2 
3 
1 
2 
3 
4 
2 
3 
1 
2 
3 
4 
1 
3 
2 
4 
2 
2 
1 
2 
3 
1 
2 
3 
4 
3 

3 
2 
3 



Readinc 



^.93 
11.67 
7.55 
7.94 
10.34 
10.15 
9.71 
10.79 
10.15 
9.35 
9.74 
9.73 
9.07 
6.24 
6.57 
10.52 
7.87 
8.46 
12.20 
10.18 
8.85 
9.80 
8.74 
11.01 
9.53 
9,05 
8.13 
9.77 
11.57 
10.05 
9.80 
9.91 
8.40 
10.31 
9.23 
9.70 
6.45 
10.10 
10.10 
10.13 
9.87 
11.50 
10.80 
11.90 
8.10 
7.25 
10.85 

12.70 
10.35 
10.80 
-84- 



Mathematlcs 

?07~ 

26.44 

19.55 

27.44 

24.24 

25.39 

24.38 

27.7 

24.82 

21.31 

22.82 

24.14 

23.05 

19.00 

i: ^1 

27.45 

22.27 

20.88 

24.90 

25.93 

23.90 

25.35 

22.41 

25.14 

22.58 

21.45 

26.26 

28.58 

24.52 

27.22 

25.00 

17.78 

26.65 

25.10 

24.95 

17.55 

21.44 

26.22 

25.91 

25.78 

28.90 

19.74 

26.10 

18.40 

19.50 

26.35 

26.50 

19.05 
22.30 
22.30 



lOO 



Science 
16.93 
20.59 
13.65 
17.59 
16.64 
18.57 
17.58 
18.88 
18.47 
16.69 
16.70 
17.95 
16.35 
12.29 
11.88 
19.27 
15.37 
13.45 
17.65 
18.67 
18.55 
18.95 
15.33 
17.14 
17.05 
17.82 
13.78 
19.57 
19.40 
18.10 
19.40 
1^^.95 
'2.72 
17.47 
17.98 
17.00 
10.55 
16.94 
18.95 
17.80 
18.11 
17.07 
12.72 
18.90 
12.50 
14.75 
18.65 

20.05 
18.10 
16.35 



Geometry 
10.50 
12.22 
7.85 
10.75 
9.65 
10.24 
9.70 
9.44 
11.07 
8.42 
9.70 
8.18 
10.28 
7.65 
6.85 
11.28 
8.33 
8.54 
9.85 
11.42 
9.15 
9.15 
8.65 
9.10 
9.68 
8.92 
8.30 
10.13 
10.22 
11.06 
11.12 
9.35 
7.98 
9.77 
10.61 
8.35 
7.00 
9.61 
9.70 
9.72 
10.70 
10.15 
7.67 
10.55 
8.70 
7.3^ 
8.90 

11.25 
8.70 
8.3S 



APPENDIX A. 2 



Size 



Grade Eight 

Mean Achievement Scores by School Characteristics 
Socio- 



)T 


Lourses 




E> A AnAin^ A 












UTTereo 


D A /V 4 An 

KGGj <c)n 


oXdXUS 


D A A #4<f n A 

Keaui no 


ndtnefftdtics 


Science 


beornetry 


■ 




1 


1 


14 •00 


CO. /b 


Zb. Oo 


1 b.bU 






1 


4 


1 0 01 


00 Cl 


oi cc 
Zl .bo 


1 O Oil 

1Z.94 






o 
c 


1 


l4,yo 


OQ 1 >1 

^o. 14 


oo C7 

Zo.b7 


17 1 il 

1 /. 14 






0 


1 




07 71 

Z/. 71 


0"T "TC 

27.75 


^ C 71 

15.71 






0 


0 


1 o.ob 


OO OC 

3Z.Zb 


07 OA 

27.20 


Ol AA 

21 .00 






A 

•f 


1 


1 O 77 


OO 1 O 

Z9. 19 


Oil An 

24.40 


1 O A7 

18.07 






/k 

4 




13, 13 


OC il 7 

Zo.47 


A M A"T 

24.97 


1 c oo 

16.33 






c 

b 


0 


I3.2b 


OC OT 

26.31 


23.69 


1 il OC 

14.25 






0 


1 


1 f\ 7C 


AA f A 

?2.58 


A A PA 

22.50 


1 A AC 

12.25 




Z 


1 


1 


13.8b 


Oil o c 

24.35 


Af 1 A 

26.10 


1 C CA 

16.60 




c 


O 

o 




l4,oJ 


on nc 


'*c on 

£0.30 


1 7 AA 

1 7.9U 




0 

c 


o 
c 


Z 


1 >i no 


on CO 
3U. bo 


07 CO 

Z7.68 


1 O il c 

lo.4b 




o 
c 


Q 

0 


1 


1 o oo 
1Z,9o 


oo oo 
Zo.ZZ 


07 7A 

27.70 


1 C 7il 

1 5.74 




o 
c 


0 


Z 


14«oU 


oo oo 
Zo.3Z 


07 A C 

27.45 


1 O OC 

lo.Zb 




o 
c 


0 


0 


1 O 70 

13«/3 


07 1 C 

Z7.1b 


OC OA 

25.30 


1 C AO 

16.03 




c 


•f 


1 


1 0«9U 


oo Oil 

3Z.94 


oo cc 

28.65 


Ol A A 

21 .90 




z 


4 


Z 


1 c cc 

1 b.bb 


oo cc 

3Z. bb 


OA "TA 

29.70 


OA OC 

20.85 




c 


a 
•f 


0 


1 o«UU 


oo nn 
Z3.U0 


Oil nA 

24.00 


1 o on 
IZ.ZO 




z 


b 


Z 


TO il C 

1Z.4b 


on 1 c 

30.1b 


OC At! 

26.45 


1 C il c 

16.45 


: 


0 

c 


b 


0 


1 1 il7 

1 1 .4/ 


Oil nc 


oo O 7 

23.37 


1 O 7il 

IZ. /4 




z 


0 


0 


1 a CO 
14.bZ 


OC OC 

26.85 


O C "TA 

25.79 


1 il AO 

14.92 


0 

c 


] 


1 


1 


14,oo 


oo oo 
3Z.ZZ 


oo AC 

28.05 


1 A CA 

19.69 


c 


• 


1 


o 
c 


1 O OC 


oo 1 0 
Z3. 1 0 


Oil OC 

Z4.Zb 


1 o on 
13.9U 


c 




1 


Q 

0 


1 O 7C 


oo 


Oil 1 o 

Z4.1Z 


1 o cc 
IZ.bo 


c 




1 


4 




OO CO 

cc. bo 


oi oo 
Zl .oo 


1 0 Q7 


c 




c 


Z 


1 O OC 


OO 1 c 

Zo. lb 


Ot 7C 

Zb. /b 


1 c cn 
lo.oU 


0 

c 




o 


0 


1 1 .OU 


1 O 1 c 

19. lb 


Ol Al I 

21 .OU 


1 on 
K .ZO 


c 




o 
0 


c 


1 o«oo 


OQ on 
Zo.9U 


OC OC 

Zo.ob 


1 7 CO 

1 / .bo 


c 






c 


1 Q in 


OC 7C 

zo. /b 


OC on 
Z0.9U 


1 it OC 

14. Zb 


o 
c 




•f 


0 




OQ 1 C 

Zo. lb 


OC nn 
ZO.UU 


1 C )C 

lo.Zb 


c 




c 
0 


z 


1 Q cn 


OA OC 

Z4.Zb 


OC 7C 

Zo. /b 


1 c on 
lO.ZU 


c 


c 


1 


1 


14«1o 


oo 7C 

Z9. /b 


07 nc 

27. 05 


1 c on 
1 b.oO 


c 


c 


1 


0 


1 1 nn 
11 •OU 


on cc 
ZO.Ob 


1 A 7A 

19.70 


7 il C 

7.4b 


c 


c 


Q 

o 


0 


1 Q QC 


oo 1 c 
Z9. lb 


Oil il c 

Z4.4b 


1 o iin 
1 Z.4U 


2 


I 


5 


2 


13.60 


29.10 


26.20 


16.15 


2 


2 


2 


2 


13.90 


26.25 


26.00 


16.85 


2 


2 


3 


3 


12.55 


27.50 


24.55 


14.75 


2 


3 


1 


1 


15.55 


38.00 


30.35 


24.00 


2 


3 


1 


3 


11.35 


23.90 


20.70 


11.80 


2 


3 


2 


2 


12.55 


30.15 


25.35 


18.00 


2 


3 


4 


3 


14.25 


28.55 


28.16 


20.20 


3 


1 


1 


2 


13.85 


26.88 


27.35 


14.18 


3 


1 


1 


3 


12.03 


21.10 


23.93 


11.93 


3 


1 


1 


4 


12.29 


22.34 


20.89 


12.61 



er|c 
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Read 

Size Courses Region Weal th Mean 



Mathematics Science Geometry 





1 
1 


A 
H 


c 


1 1 ./O 


OO OA 

23.90 


Of* J A 

25.40 


12.70 




1 


A 
H 


o 


1o«oo 


07 OC 

27.25 


A /" A A 

26.20 


^ J A/> 

14.90 


0 


1 


0 






on 1 A 

30,10 


A A A fT 

28.25 


17.60 


0 


o 
c 






11 17 

11.17 


07 ^ C 

27«lo 


A il A A 

24.22 


14.33 




Q 

0 




1 


1 c on 


Ol AA 

31.08 


29.05 


16.00 


0 


Q 

0 






14 26 


OO A A 

33.00 


27.81 


19.00 




Q 

0 




0 


1 O Cf\ 


OA T IP 

20.75 


^ A 1 r* 

19.35 


20.48 


Q 

0 


Q 

0 




0 


15.30 


^ fT A#^ 

35.90 


29.65 


10.85 




0 




1 


1 o on 


O^ 1 o 

27.13 


26.63 


^A 

21 .50 




1 




1 


1 il If* 

14.15 


25.45 


28.45 


17.05 




1 


] 


*j 
0 


1 o oc 

12.25 


O O AA 

23.80 


23.80 


16.90 




1 




4 


11 .58 


20.40 


18.87 


11.35 




0 


o 
c 


0 


1 o no 


Oil il ^ 

24.47 


A J /> r* 

24.05 


11.24 




0 


o 

0 


yi 
*f 


1 n cc 

10.55 


OO OC 

22.35 


A A ^ A 

20.70 


14.33 




0 


1 




1 o. /U 


Zo.Ub 


OO OC 

28.85 


1 o nc 

12. 9o 




3 


4 


4 


10.95 


16.75 


16.90 


17.75 




3 


1 


1 


13.78 


27.15 


25.56 


17.48 




3 


1 


2 


15.23 


33.48 


28.33 


21.35 




3 


1 


3 


13.75 


2^.. 72 


26.75 


16.85 




3 


2 


3 


12.41 


23.48 


23.80 


13.25 




3 


5 


3 


11.85 


19.80 


21.65 


10.10 




3 


3 


3 


12.60 


25.25 


24.00 


16.90 
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APPENDIX A.3 
Grade Eleven 

f^ean Achievement Scores by School Characteristic s 



Size 

of Courses 
School Offered 



Cofnmun- 



Geo- 
graphic 
Location 



Social- 
Economic 
Status 



READING MATHEMATICS SCIENCE GEOMETRY 



1 


1 


3 


3 


1 


10.30 


25.85 


29.50 


18.75 


1 


1 


4 


2 


1 


11.82 


30.46 


34.26 


23.28 


1 


1 


4 


3 


1 


11.39 


31.82 


34.27 


24.47 




1 


4 


3 


2 


12.45 


32,08 


33.16 


25.68 


1 


1 


4 


4 


1 


11.73 


30.16 


33.41 


24.40 


1 


1 


4 


4 


2 


11.89 


29.77 


33.09 


23.94 


1 


1 


4 


4 


3 


10.15 


24.45 


30.25 


20.55 


1 


1 


4 


5 


1 


12.50 


28.80 


33.75 


23.60 


1 


1 


4 


5 


2 


11.03 


29.93 


33.85 


22.25 


1 


1 


4 


6 


2 


12.25 


30.32 


31.55 


21.30 


1 


1 


4 


6 


3 


10.22 


22.72 


29.07 


15.83 


2 


1 


4 


4 


1 


12.20 


27.95 


33.10 


21.90 


2 


2 


2 


2 


3 


11.10 


26.75 


32.48 


20.88 


2 


2 


2 


5 


3 


11.11 


29.63 


29.32 


19.05 


2 


2 


2 


5 


4 


10.40 


22.20 


23.90 


17.50 


2 


2 


3 


2 


1 


12.85 


33.45 


35.15 


29.55 


2 


2 


3 


2 


2 


10.75 


30.05 


28.95 


23.15 


2 


2 


3 


3 


2 


13.50 


33.20 


34.10 


27.25 


2 


2 




4 


2 


12.15 


30.55 


32.45 


21 .35 


2 


2 


3 


4 


3 


11.74 


28.18 


31.91 


21.78 


2 


2 


4 


1 


4 


11.95 


29.65 


30.25 


18.95 


2 


2 


4 


2 


2 


10.50 


32.00 


35.85 


25.15 


2 


2 


4 


3 


1 


11.65 


28.90 


32.45 


22.80 


2 


2 


4 


3 


2 


12.08 


29.10 


31.58 


20.93 


2 


2 


4 


3 


3 
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